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SUMMARY 



, The main purpose of the ctudy was to provide information that could be used to 

' . 6 • •« • \ 

mate decisions 'about, instructional support for THINKABOUT in Wisconsin arid for 

future* instructional television series. The study wa^ designed £p identify teacher 

and student outcomes from using THiNKABOUT,- needs o\f teachers to h^lp them better 

implement THINKABOUT, means of expanding' the use of THINKABOUT, and implica tiorrs 

for the-s^jjpport and production of other ITV series. The sources of data were 

teacher questionnaires, teacher telephone interviews, student questionnaires", and 

student responses to four problems. The population of teachers from which all [ . 

part Tefpants aind their students were part of, were 95 teachers of* a random sample 

of 800 Wisconsin fifth and sixth grade teachers who volunteered to be i^ a 

follow-up' study of THINKABOUT. Trom this group/ 58 teachers who were using 

* * * - - 

THINKABOUT returned a questionnaire, nine teachers were interviewed by telephone to 

♦validate fie questonnaire information, seven teachers who -had used THINKABOUT the 

I ' ' . ' * ' - • 

previous yoar but were not using it during, the 1980-81 school year returned a 

^* ° . > # * * 

j * ~ * ' - s 

quest lonna ire, five teachers 'returned questionnaires completed by five or six of 

their students, and eight„of the teachers* allowed three grouas of four students 

f*ach to be observed as each group worked four' problems. Two of the eight classes * 

had not viewed any programs from-THINK ABOUT- All of the data was collected during-, 

Spring 1981. The three groups oh students w^ho'were interviewed from each class were 

*# • • 

' ' " ' * ' ' 1 

elected randomly from\ the class.' As the groups attempted the four problems, . the 

responses of the students we're recorded on audio cassettes. A*f ter \omple'ting *wor«k 



on .the problems, each group was interviewed. 



ittes. ter *pomple*tir 



Approximately one-fourth of the grade 5 and grade 6 te'achers in Wisconsin were 
projected to be using THlNK ABOUT *f3uri rig 'the 1,980-1*1 school year. The average 



amount of, time a.week* spent ,on related activities to THINKABOUV was 48- minutes— 



i* 



erjc • .; , • : "•*•' / ' ' ■■ 0 



30 minutes viewing th^ programs, 6 minutes in pre-activities, and 1*2 minutes in 
discussion fpllowing the programs. Only one-thii^ff of the teachers did some other 
in-class assignment. Teachers and^tudents were ve*v^ positive toward THINK ABOUT. 
THINKABOUT appeared to be successfully related to strengthening the students 1 
abilities to effectively express themselves, and to effecting some facets related 
to having students manage their own learning and to think flexibly. Evidence of 
the relation' of. -THINKABOUT to strengthen systematic reasoning -was not substantiated 
by all sources of information. Students were able to recall very well the stories 
from the programs, however students who applied the ideas in the programs were 
yiose who had done more related classroom activities. In general, THINKABOUT did 
.appear to supplement the growth' in students of problem solving a<nd independent 
learning. ' ( ff 4 

Even though only a third of the teachers expressed interest in* attending an 
in-service, there were indlcatfBhs that teachers would beneiit from an in-service 
bemuse of the small amount of time spent on classroom activities Related to 
TKINKABOIW. Any in-setvic^ would have to respond to the critical concern of 
teachers of priding the time during the school day to plan and do THINKABOUT 
activities. A useful in-service would help teachers fit THINKABOUT activities into 
their basic curriculum. Two possible directions of expanding the use of THINKABOUT 

in Wisconsin arc to teachers in schools where other teachers are using THINKABOUT 

* « - ' / * 

and to teachers'at schools where THINKABOUT is^not being y used. Each o£ these 

groups would have ^differejit needs and situations that should require different 

« s 
• ** • 

implementation procedures. Implications of THINKABOUT to other ITV series to be 

■** . 

produced for grades 5 and 6 include using students at that age level, making 

situations re-tivant and believable, and using some related programs such as a 1 

serial. The story lines aide$ in recalling what the program was about, But ^ 

t 

follow-up classroom activities w.ere important in having students apply the Skills,. 



INTRODUCTION 



One<of the most extensive prpjects in instructional television 'culminated with 
the^debut of the THINKABOUT series" in September 1979. A High' priority was placed ' -* 
on' fundamental learning skills by educators and broadcasters' attending four . 
regional meetings convened by*the Agency for Instructional Television (AIT) , the 
developer 'of THINKABOUT, during, the Fall of 1973. This was the beginning of a . ■ 
project that eventually cost $5 ,700 ,000, involved 42 states and provinces as 
consortium-members as of September 1981, and produced a series of s**ty, 15-minute 

* 

color programs for fifth and sixth graders. Wisconsin, with a history "of ' 
.. supporting instructional television, was onl of the 14- states who was a par* of the ^ 
• THINKABOUT. Consortium from its formation in 1976.. ' The 'end of the production of 

THINKABOUT was viewed as a -beginning of a new instructional-expedience available to 

students in Wisconsin in"a field scarce of available materials' or resources. 

During the. first year of broadcast, 24% of ^the fifth and. sixth grade , teachers of 



Wisconsin used the series. 



\ 

The ma 



in focus\> 



f THINKABOUT is thinking skills which underlie the va 



rietal \ 



basic skills of language arts, mathematics, and study skills and that transcend, the 

• * • , $ 

boundaries of these traditional content areas. The series is designed to help\ 

students become independent learners and pr obIen» solver s who have the . confidence 

and ability to live and. produce in a changing world. The goals of THINKABOUT are 

to encourage the development of %rrd to' strengthen in young 3 learners the abilities ■ 

• • • 

to effectively express themselves, to manage ^their own learning, to reason,/ ' 
systematically, and to think flexibly. The 60 programs can be used in a variety of 
ways— as a vehicle for promoting thinking skills in * problem-solving 'context, as a 
means of teaching 'problem-solving techniques, or as a stimulus for Reviewing 
specific language-arts, mathematics* or study skills (Sanders and Sonnad, 1981). 
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Evaluation was a major component of the development process ,of THINK ABOUT, 
♦ Prom the beginning, clarification, concipt development; and review of 'ne'bulou^ 

terms as "fundamental learning -skills" were obtained ^rom educators and« / 

m 9 

psychologists 'well respected iYi their fields.' Tjae production staff continually 

i ' -' ' % 

evaluated treatments, scripts," arid programs using techniques such as criteria 

• * * • r " • ! 

checklists, which provided a quality control of programs and assurances that the* ' 
production pa^ts met' certain expectations' (Sloan, -1980/ p. 146)." As programs - 
became available, a field test was conducted of the Collecting. Information cluster", ' 
consisting of three programs, to assess the effects of'a group of programs (A£T, 
1979).. The evaluation of THINKABOUT continued through the first year of broadcast 

V • 

witfr an impact and research -study conducted by Sanders and Sonnad (1980) 

tffre impact study, involving 24J. classrooms in four consortium states, provides 

insight \nto some .of the outcomes of THINKABOUT. The programs" captured and k£pfe 

. *' * ■ c 

the attention of .virtually all students, and teachers who viewed them. ^ Classroom 

<m. 

discussions of thinking and reasoning -skills were stimulated by the programs and 
accompanying materials* Teachers perceived student improvement in each of the 
thinking skills areas cov.erej? by the series as~a result of using THINKABOUT. 

; 

Class'rooms viewing THINKABOUT demonstrated differences on ceftaln communications,,, 
skills, exercises and independent learning exercises-ljrom classrooms which had not 
viewed ahy of the programs. Students Viewing the series provided more options ' 
and/or alternatives, in the. problem seating on certain items.- Differences between 
users and non-users were not observed on standardized achievement test spores. ' 4 
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PURPOSE OF STUDY 

. THINKABOUT. his been used in Wisconsin* for two. school years. The current 

information that is available about the'use of THINKABOUT is the percentage of 

fifth and- sixth grade teachers who had used thl series during its first- year, 24%. 

This was. obtained from one of the random sample sucveys periodically sent to « 

different groups of Wisconsin ^eache&s to detecmihe the use*of instructional 

television and 'radio in the state. Very little information is available regarding 

how THINKABOUT is being used' by teachers and what. its effects are. 

Instructional television programs ar-e design©/ to be .a part of an educational 

experience that includes- provocative questions as an introduction, discussion as 

-immediate follow-up, and \instructional activities in following days for 

reinforcement of the ideas presented. %o bette* effect the use of .instructional 

•television and its impact in Wisconsin," the Educational Communications Board is 

interested in providing support for instructional television to reach its full 

potential. The main purpose of the>tudy is *o provide information that can be 

used to make decisions about instructional support for THINKABQUT in Wisconsin and 

fbr future instructional , television series. - 

^ THINKABOUT was selected to be the major focus pf this study because of. two ' 

. ■ v * ? 

reasons. - The high quality of production and the extensive research and Evaluation 

that went into its development should be a motivating'f ac.tor for teachers to use 

THINKABOUT as effectively as possible." -.The support given' to the series should be 

art example of what.pan be done.. Secondly, THINKABOUT presents a numbed of skills 

'over a large number df programs that -should result in'many possible ways of • ' 

supportmq the series. How some teachers are supporting THINKABOUT should provide' 

insight Into innovative meanfc that can be used in supporting other series. 



The main questions to be 'answered .by the 'study a're: * ' 

1. Whabare the effect^ of THINK ABOUT on teachers, students, and^ - 
* instructional programs? , 

2* What instructional support do teachers need to implement THINKABOUT more 

•v ' ■ 

<ef fectively? . , ' 

3. «, «\fli$t can be done to 'expand the use' of THINKABOUT in Wisconsin? 

4. ^ctfh$t implications are ther.e from the implementation of THINKABOUT over two 

• ■ 

years'for the support and t production Of future instructional television 
series? * . 
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DESIGN 



Procedures * * ■ 

— , . ♦ . « -< 

A group of teachers wh£ had volunteered '.to participate in a follow-up study of 

.THINK ABOUT completed que%tlqnna if es in April and May 1981. This group consisted 0/ *L 

• Jieachors who were cu 5 ren*iy using THINKABOUT, either regular ly' or occasionally; or 

>who had used THINK ABOUT the previous year but w^re not currently, using the series. 

• •» ' • '**'"••'• * 

The latter group Was sent 'a modif ied~version of the - questionnaire ,. including / 

questions about why the teacher was not 'currently using, THINKABOUT. ' Irr addition to 

completing the quest ionVai re ', three groups of teachers currently using THINKABOUT , 

were asked to participate in other part's of the study , ' Students o£ one* group of 

six teachers, albng with two control^classes notj using THINK ABOUT, were observed 

* ? * * " 

and interviewed as the students solved four problems while, working, in small groups I 
- - ' * - « . ' 

of four. For.£his part of the study,' three groups' of students -were- randomly ' 

selected from each class or unit to )De interviewed. These interviews were ' ' ' * 

conducted after -the last TH I NKABQUT program was fcroadcasfon May -6,. A second group 

of six teachers* was asked to administer' ! student questionnaire to six of their 

students selected randomly, from their class list. A third- group of nine teachers 

» V 

was interviewed by telephone to validate the" written information collected by the 
questionnaire. These groups were selected using a stralified random sample to ~» 
ensure that both grade 5 and-grade 6 were equally represented.- Thus, the sources . 
•of information for this study .were teacher questionnaires fr.om' THINKABOUT users,,' 
teacher^ questionnaires from previous users of THINK^OUT,' student protocols and 
response's to four .problems., teacher interviews, and student questionnaires. ' 

X ' '■ . * . 

Sample 

* ,ln February 1981 a letter of inquiry and a' return postcard' (Appendix E) were" 
sent to a random sample of -800 gt.ade 5 and grade 6 teachers- in Wisconsin. The " 



/ 

< 



letter asked if the teecher was presently usin$ THINKABOUt 1 , if the teacher had used 

THINK ABOUT the previous year, and if the teacher would be interested in ' 4 • 

.participating in a follow-up study of THINKABOUT,' No additional mailings' were made 

to those who had not returned the/ postacard/ Only those teachers who returned a 

postcard and had indicated they woujd be willing to participate in the study were 

asked to be in* the study. The sample for the study then was'a Sample of " 

convenience rather than a random sample, and included only teachers who had ' 

volunteered to be in £he study* • \ \ 

The number of teachers who returned postcards was 256, * S N ix' ofr thesp teachers 

*were teaching grade 4, four of which had never used THINKABOUT, ancfweire not 

inclu^ in the analysis of , fehe ^ample. Of tfce 250 remaining, teachers, 121 (48%) 

taught -grade ft, f39%) taught .'-gcada 6, and 32 (13%) taught a combination class. of 

v , 

grades 5 and 6-. Jbis Sample is weighted toward grade 5 teachers, however not 

statistically significant using a chi square test, when compared to. the proportion 

ot teachers who .responded to a random sample survey -'regarding social studies 

administered dutin'g school year 1979-aO- On that random sample, Survey , 44% of the 

grade 5 and grade 6 teachers taught grade 5, 42%- taught grad e/ 6, and 12% taught a 

combination of grades 5 and 6. One possible explanation for the slightly skewed » 

sartple is that 'elementary teachers were more willing to be in the study. 

The teachers Ufio completed the THINKABOUT teacher questionnairevwere a 

proportion of the 95 teachers who noted'on the pqstcard that they would be willing 

\ 

to participate in a THINKABOUT follow-up study. Of the 78 teachers from thip group 
who were, using THINKABOUT during th<* 1980-81 school year, 58 of the teachers (74%) * 
returned the questionnaire. Of the refining 17 teachers, nine Had usla THINKABOUT 
the previous year but were not using it during the 1980-81 school year, and eight 
had nevec^used THINKABOUT, Ifcose who-had u^d THINKABOUT were also, sent a 



-7- . ' \ 

* 

questionnaire regarding their use of the series and. their reason for not using it 
> « for 1960-81. Seven, or 78%, of these teachers responded to the questionnaire. The 
sample consisted of those Jteachers who were -interested enough in the'study to take 
% the time to. complete the 5-urvey. life sample then probably contained teachers who 

were more favorable and interested in ^THINKABOUT. Therefor§, the results of the 
' questionnaire prob ably reflect the opinion of teachers who have had more positive 
4 » experien ces with THINKABOUT rather than a random sample of thos^sing THINK ABOUT. 

m * » 

Six teachers using THINKABOUT and tVo teachers not using THINKABOUT -were 

*• * • / ~* 

selected from the 95 teachers who expressed willingness^to participate in the study 

to have some of their Students interviewed wh.ile solving problems. The initial 

design was to have three triads of classes, with one triad consisting of classes at 

j the same grade^ level* from schools in approximately the same size of community. 

The three classes in each triad we^ to have feathers who varied in their length of \ 

< experience in using THINKABOUT. One class was .to have a teacher who had used 

THINKABOUT two year s, pne class was to have a teacher who had used THINKABOUT -one 

v * 'year only, and one class was to have not used THINKABOUT and was to have a teacher 

•who had»never used THINKABOUT. One triad was to be all grade 5 classes, one all 

« -grade 6 classes, and one containing combination grade 5/6 classes. 

Not all teachers contacted had the time or the interest to participate in the 

x study when they were explained the details. As a result, in order to have classes 

from the same community who were using THINKABOUT In the proposed grade 5/6 triad, 

one grade 6 class and one grade 5/6 class were Qsed. A 'control class was not found 

in^he geographical area of the other classes of this triad to be used- in the study." 

A description of the three triads and the code number given to each/class are .given 

in Table 1. Classes 115 and 215 came from the same community but from different" 

schools, as did classes 136 and 235/6. The classes that participated in the student' 

^ interviews then included those* f rpm different grade leveis, different sizetf 

communitier>, and had teachers with different amounts of experience using THINKABOUT. 



\ 
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Table 1 

Description of Triads and Code Number of Classes 
for Student Interviews- 



Triad 1 



Grade level: 
Community size; 
Proximity:^ , 



Code number: 

Teacher has used 
THINK ABOUT 2 r yr 

Teacher has 
used THINK ABOUT 
regularly 1 yr. 

Teacher has no^ 
used THINK ABOUT 



4,000-5 *odo 
* 

50 miles from 
Milwaukee 

115 



Triad 2 



215 



315 



1,000-3,000 

15-40 miles from 
an urban area 



126 
226* 

326 



Triad 3 ) 
5/6 & 6 
50,000-70,000 



V 136 



2,35/6 



Not included^ 



A class list was obtained from each of the eight teachers who were willing to 

* o 

have their students interviewed. In some castes'the class list included all of the - 
( students at grade level if students were grouped' as a unit for 'some instruction.' , 
•Thrsee groups of four students each were selected randomly from v the list, along with 
four alternates. The groups of students interviewed then were not special groups of 
students and .had not worked together as a group prior to the interviews. Because 
the groups were randomly selected, they should b4 representative of the classes from 
which they were selected. 

The six teachers who were selected to administer student questionnaires to a 
sample; of th^ir students fand the nine teachers who were interviewed over the ^ 
telephone were selected randomly with the constraint that both grade levels, 5 and 
6, were nearly equally represented.' Five of the teachers returned student. 

A 
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questionnaires.^ Four of these teachers had used THINK ABOUT regularly for two 
years, and one was currently using THINK ABOUT on occasion for. the first time. A 
total ©f 29 student questionnaires were returned, 41% from'grade 5 students and. 55% 
from grade 6 studen-ts. The respondents were nearly evenly divided by sex, 48% were 
male and 52% were female. .Of the nine teachers who were interviewed over thes, 
telephones five had used THI^OUT^gularly for two years, three had used " * 
THINK ABOUT regularly, for the .1980-81 .school year £or ^ e f "st time! and one 
teacher had used THINKABOUT on occasion for two years. Of these teachers-, four 
taught- grade 5, three taught grade 6, and two taught a grade 5/6 combination. The 
sample provided information from both grade 5 and 6 teachers who had a range in 
experience of using THINKABOUT. .* ' . * . 

Instruments ' V - * 

/ ' ' ' 

The tfeacher questionnaires are included as' Append** A. Many of the questions 
*|d the format bame from the questionnaire used in the.AIT impact study. .The 
telephone intervfew questions were designed J^varaUel questions on the ' 
questionnaire. The, student questionnaire (Appendix B) is the same as" the 
questionnaire used by AIT. 

Twelve problems selected from those used in the AIT impact. study , curriculum 
material on reasoning, and problem-solving mater ial "were tried with small groups of 
students from one class which had viewed most of the THINKABOUT programs. The four 
problems (Appendix C) selected for the'study were the problems 'that generated " the 
most responses and stimulated the use of a variety of thi thinking skills 'presented 

in THINKABOUT- as students searched for solutions. 

• - ' * < ■ 

Different think'ing skills could b*. used*in4olving each of the problems * • ' 

r . i • 

Problem 1 has an impossible solution The students were to explain why the 
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solution is impossible* Jh" order t6 solve the problem r students fiad to deduce from 
the conditions of the problem that it is impossible to distribute nine marbles into 
five cups with a different number in -each cup. One possible explanation is that 
the sum of the five smallest 'integers— 0> 1, 2, 3, 4— is more than 9. In solving - 
this problem, students had ,to derive meaning from the conditions of the 
problem — different number in each cup r nine marbles, and five cups. .The 
information of the problem cart be analyzed and reshaped' by using diagrams or other 
models*of the situation. Information can be judged* and a conclusion made that,^ 
with the information given r the\\problem is impossibj^ Deriving an adequate 
sblution to -this problem' Requires trial'afld ,er t ror, persistence, taking a risk, and 
t other processes required f<br successful problem solving. 

Problem 2 requires the ^comparison of ^ the similarities and differences ^between 
two situations and drawing f ^ conclusion. The students were faced with the problem ' 
of explaining why the removal of one of four legs on" a chaif causes it to fall over 
.when other three-legged stools, such as a tripod or an X easel, are verjr sturdy. This 
is a problem of reasoning by-' analogy (Harnadek, 1979). Meaning must be derived 
from the different situations. Different attributes, of. >5 the .two types of structures,' 
three legged stands and four legged stands, must be' Classified. Diagrams can be 
used to represent the i^onrt^tion and judgments can be made about what information 
is relevant. -Finally/ conclusions have to be made by drawing inferences using 
analogy. 

. The third and fourth problems are multiple questions which require planning and 
the generation of information. In the third problem, students were to plan for a 
radio station for their schobl. In the fourth problem, students were to identify' 
steps £hat, Jim should consider and perform mi making a model spacecraft for a 
science fair. 'Both problems require generating and collecting information and ' 



1 < 
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listing^alternatives. In^^^me of ,the questions for each problem, students were 
asked/to order the steps* Since these problems are life-like problems, they 
r4qt/ire the consideration and specification of criteria such as what do people want 
to listen to on a school radio station, and what' are. the rules of fee science 
fair. "The radio station problem also requires judging information and identifying 
important information* from lesU important information. The science fair problem 
requires summarizing (reshapirb information) and planning a presentation ' , 
(communicating effectively). ! 

* i I - • " 

Each grSup of four student^ was allocated one hour to solve the four problefns. 

Students were instructed before! beginning problem 1 to work as a group and to record 

in the space provided an answer agreed upon by all of the students" in the group. ' 

The students were- asked to verbalize their ideas and to discuss the ideas with each 

other. TH INKABOUT was no}: mentioned before beginning td solVe the problems, the 

comments and discussion of each group were recorded on audio cassette tapee. Once 

* ' * • 

the students began forking on the problems, '-the interviewer only spoke if the .group. 

was silent for a lo>g period of time'or if" the group reached a complete standstill. 

The groups were asked general questions about THINK ABOUT and related activities 

after finishing the Spur problems if time allowed. 

* i * * . • 

Analysers ;, •/' 

For the teadher and student questionnaires, frequencies of responses were 

computed for the multiple choice items and means and standard deviations for the 

* ' \— ' /' 
scale items. Results are reported for the individual^ items. Teacher responses ' 

from the telephone interviews we're compared with questionnaire responses. Each/ 

group of IfjKnts received a score or scores on^each of £he four -problems. Class 

scores on each problem were computed by taking the averag^s^ores* of the three 
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gtoups from the class for problems 1 and' 2, and the .sum of scores for each group on 
problems 3 and 4. The class scores were used in the analysis.- 

The investigator scored each item using "a predetermined scoring scheme 
(Appendix C) . Problems 1, 2, and 3 were' scored on two independent occasions by the • 
researcher to check consistency in scoring. All of the group responses and fcores 
on problems^ and 2 and a sample of responses and scores on problem 3 are included 
as Appendix D. Problem 4 was scored by the investigator and one other 'person 
independently using the scheme developed by Covington! the developer of- the item, 
. which was used in scoring the item for the AIT impact study.. Each group on problem 
4 was given a score on 27 variables. The percent agreement between the two scorers 
on the 648 scores for the 24 groups was 88%. The score given to the group where' 
there was disagreement was the consensus reached by the two scorers after * " 

discussion. . • * , * ' 

' the total joints given on each problem varied. A total of 10 points was given 
on .problem 1, which wa S> the sum of three subscbres— ' 0-3 points for understanding 
.the problem, 0-4 points for* the* means used to solve the problem, and 0-3 points for 
the solution. A maximum of three points was given on problem 2, which represents 
the inplusion or. absence in the response of each of three parts— the accurat^ , 
description of the properties of a three-legged' stool (1 point)-, the accurate" * • 
description of the four-legged chair (1 p^int) and the accurate conclusion drawing. • / 
from the differences and" similarities of the two situations ("l point). 

Problem 3 consisted of two pages. -The responses given on page J were ' • 

characterized as tactical— those which -are specific features of a radio station ' ' ; 

such as equipment, building" space, and -programming; or # as strategical—those which 

are planning steps such as setting up a" committee, collecting information (survey)*, 
•» - * 

and considering constraints such as*fime. The sum of tactical response's was the 
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tactical score and the sum of strategic responses was the strategic score. In 
add it ion/* each group was given ohe'point for each of foui#?variables--scope and 
dimension, information; resources and equipment, and sequence of steps—depending 
upon \he presence or absence ot items representing the variable. Three questions 
were asked on page 2.- On question 1, the groups were given two scores. One was 
the number of responses that were forms of information, and tn^e othe"r was the number 
of responses that listed equipment. The number of resources listed was the score 
given for question 2. Two scores were given for question 3, the number of decision 
steps listed and a score of 1 or 0, depending on whether items were listed in 
sequence or not. 

8 

Groups were asked to respond to five questions for problem, 4. Cta each question 
^he gro\ip was gWn a score P f J the number of responses on the variables for that 
question. On the first question, page the groups were given scores on two 
variabl&s— deadline/time and people to help/- other variables were not scored 
because they appear in other questions, such as 6n page 4. The two questions on 
page 3 ask for sources of answers to questions. The first questions on the fai* • 
deadline, was given scores on -school staff, parents/relatives, . fr ie^ds/clasimates, ' 
fair staff, and media. The variables for the second question, on what a real space- 
craft looks like, include the same first three variables as the firs$ question, as 
well lb print materials and other ideas. The scores on .these questions represent' 
the awareness of groups to consider different sources. of information, *0n page 4 
the groups were given scores for strategic variables— scope/dimension, information/ 
advice, assembling resources, and globSl statements; arid tactical 'variables-- 

.4 

construction, pa-inting, and other ideas, in addition^ each #roup was given one 
poinfc on an order variable If. the responses were .listed in some^ order. The fifth 

• * 

•question asked the students what they*would do if the deadline for %he fair was 



sooner than they had planned. *Scoreswere given for seven variables— work harder, 
give up/ stop and "salvage, reduce scope, postpone deadline, get helfr arid other' 

/ 

ideas, • , ' , * N 

• # • 

^ Verbatim transcriptions were made of the cassett* recordings^ the groups. A 
check wa^made on the accuracy of,the transcr iptins by having two people transcribe 
the same; problem for one group. tyese two transcriptions are included as Appendix 
F. All transcriptions, protocols, were analyzed for specif ic examples -and. evidence 
of the four general characteristics* of independent learners. Evidence of the . 
following characteristics was sought: 

Effectively expressing* themselves: * ' 

Communicating ideas to others " . {j ^ * 

W ' Listening to ideas of others t 
/ • • Grdup discussion , ' * 

Supporting comments • „ 

Group cobperatio\; **. ✓ r - 

Managing their own learning: ' -V 

Planning s * 

% / Gathering arid generating information . 

# > ' Organizing information ' 
Asking questions of groups 
Redirecting the group 
\ Making inferences * c 



Reasoning sy sterna ticariy: * 
Planning 

Not>qtj details ' 
Checking 
# Using criteria 
Judging information 
Considering alternatives 
Finding patterns^ 

Tninking flexibly: 
Brainstorming' 
Considering alternatives 
% Using criteria 



.information <6n the four general characteristics was obtained for each 'class 'byV ' 
identify!*. common evidence of characteristics found in all three groups from^ 
class. . If ^tttdents .from each group exhibited the same process, the process was 



r 



assumed to 'be a characteristic^ the ^^^^|racter istics of ' THINKABOUT 
classes were contrasted with the non-THINK^lOm 
noted. Evidence for many processes was not.Jd$dj 



fesfs^s ^ind differences were 



>^M?n^ the protocols of all three 
, groups from the- class. For these processes, g^^f^Wes^ere considered 
across all of the THINKABOUT groups and compa non-TH I NK ABOUT groups. 



groups 

These processes are less lively fco.be character J^Sfc of Classes but suggest a*reas 



where THINKABOUT may have affec^fed some students 



• • in order to draw any conclusions from this study, findings from a source had to 
be validated by findings from other sources. "The'more quantitative information ' " 
. from the .questionnaires and answers to the prpblelhs -were used to support or 
discredit the more qualitative information obtained from, the ^dtocols and-vice * 
versa." A reasonable link between THINKABOUT and the results had to be made, as 
well as the. rejection^ that the results may-b, e 'due to other .causes before - 
conclusions we« made. ' Because of the snjall sample size a 9 d how the sample was 
selected, the conclusions can only be suggestive . r^the>£han ^definitive about the 
^effects' of THINKABOUT. • The study Is sufficient for the conclusions- to providl 
-direction about how to support teachers using THINKABOUT. - . " 
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< ^ . ^ RESULTS ' ' 

Sample Description „ ^ • 

v 

Wisconsi>n teachers representing a range ot years of "teaching- experience are, 

using THINKABOUT. Of the 58 user teachers who returned the survey, the average 

number ot years of, tull-time teaching was 15, with a standard .deviation of 9.b. 

Tl%e~ range of experience was from .ond- teacher who* was in the. first year of\ teaching 

to oneOwho retired j.n June 1981 after 41 years of teaching/ A large number (95%) 

t * * 

of the teachers who responded are experienced teachers with three or more years ot 

■ * ■ . 

tull-time teaching. - v d 

The sample oi teachers whd responded to the survey was weighted towarc^tiith / 
grade teachers, with 55% teaching grade' 5, 36% teaching gr,ade 6, ana. 9% teaching 
gratfe 5/6 combination. Tne\ type of classrooms of the teachers fcas nearly evenly 
spirit between self-contained classrooms (43%h.ahd unit or team teaching (45%) , 
depending pr^j^rily on the grade level taught* t Nearly two- thirds of the fifth 
yradtj teucners taught in self-contained classrooms, whereas two^ thirds of the sixJlIi 
giade teachers taught in units/teams or by departments. The teachers cannot oe 
classified as having a particular content area of speciality since only a half ot 
the teachers noted having a speciality, with* the content areas of social studies 
and language arts mentioned most frequently* Three teachers reported math as a 
specialty, two reputed science, and one reported af fe'ctive learning-* 

The sizes of the schools of the teachers responding varied from one' school 
having only one teacher for fifth and sixth grade, to one school ifaving 12*' 
teachers. The mean number of fifth and sixth grade teachers was four, v At most 
schools, nearly 70%, THINK ABOUT was not used by all ot tne grade 5 and 6 teacners. 
At r 24% of the schools, only one teacher used THINKABQUT; at 35% of the schools, two 



teachers used it; and at -24% o£ the schools, three teachers <usec) it. At a few^/* 
schools THINK ABOUT was either used by all of the grade 6 teachers or all of th^« 
g^de 5*teachers. The range of the number of students with whom teachers used 
THINK ABOUT was fronT18 to 250 studenjts, with a mean of 55, reflecting that ove* 50* 

of the teachers taught as part of a team/unit or* department. Most teachers (90%) 

• • • ^ 

used THINKABOuf''with all of their' students/ with only 10% of the^teachers using the 

series with a particular class such as homeroom, English, or -guidance. 

< THINKABOUT did. not generate a new audience for ITV, nor did many teachers 

j receive training in the use pf THINKABOUT. . Other ITV series had "been used by * 

nearly all of the teachers (88%). Only a few (12%X of the teachers had received 

any type of an in-service on THINKABOUT — 3 % had received a school worksl)Pfrr^%-a 

district workshop, and 6% a regional workshop. 

The six teaches who were using THINKABOUT and whose, students were inter^ewed 

differed soroe from the sample of teachers responding to the survey 

interviewed classes wer£ weighted* more toward grade six, including two f if th .grg£e 

classes, three sixth grade classes, afnd one combination 5/6 grade class. The . 

x \ 1 ' , 

teachers, <5n the average, were more experienced, averaging 19.5 yea'rs of - 

experience. The classroom setting had nearly the same split <js the large sample, 

with half of the classes being self-contained and the othes half organized as units 

or departments. Two-thirds of the teachers in the smaller sample had 3 content* ' 

speciality, d slightly Higher proportion than the larger sample. All of the 

teachers in the smaller sample useci the series with a£l of their students', which 

averaged nearly 41 students per teacher, which was lower than the av^rag| for the 

larger sample. Although the statistics of the smaller sample were ^t^exactly the 

same- as the larger sample, the differences were small enough that it was assumed 

that the six classrooms wete fairly representative"^^ the larger 'group. 



«^ An !ndipation of the 'achievement of students *in each class was obtained from* 
available standardized achievement test scores for seven of the eight classes from 
which students were interviewed* - Two of trh'e fifth gcade -classes only .had available 
scores from tests administered while t:he stucjeftts were in third, grade, two classes 
had scores available from ttiet year before, an^ three classes had scores from tests 
Dust administered. The -Stanford .Achievement Test was used by, four of the classes, 
•the Otis-Lennoh Mental Ability Test by two 'of 'the classes, and the M|tropolitan 
Achievement Test by op? class. The range in gpade equivalent or percentile scores 
and the mediums for each class were contrasted to provide some evidence of the - 
■ achievement levels of thfc classes. The medium scores for eac^ class were at grade 
leveTL or above for tlTe age level when eacfr class took the test. Two of the plasses, 
215 and 226, had higher mediem scores relative to the" expected "grade equivalent 
^cores than did the other clases. The medium of four of the classes — 126, 136, 315, 
andsi26--were closer to the expected grade equivalent scores.- The medium grade 
equivalent of one class, 115, was the same as the expected grade equivalent score. 
The teacher of the remaining^class, 235/6, reported, that most of th,e students -in the 
class were\reading>and dofng. math at grade level. ' Thus the achievement levels^of 
the, classes 'that participated in the* study were at grade level or slightly above. 
The level of achievement of the non-THINKABOUT classes was slight!^ above the 
expected grade leW, as wore most of the* THINKABOUT classes. Achievement was not 
a factor that separated the THINKABQJJT classes from the non-THINKABOUT classes. 



^Validation of Teacher Questionnaire 

Informafeiort ,from the\elephohe interview? of nine of the'teachers asked to 
comple^ the questiqnnaire\enelally supported the results from the questionnaire.' • 
*TW9 comparisons were made, oXe Jetwee^a teacher'.s response on the questionnaire 



and his^ef response in the interview," ang the second between the aggregated* 
responses'on tf*t>, quest ionrraiTe- and all of the responses for the. interview. There 
was 'high agreement between the interviews and questionnaire responses on why' ' > 
teachers used THINKABOUT, effective ways of using THINKABOUT, student outcomes', 
information abou,t other teachers from the school using* THINKABOUT and ways of 
using THINKABOUT more effectively. There was some, disagreement in reporting' the 
total. amount .of" time spent oti THINKABOOT-related 'activities and in reporting how 
THINKABOUT is used in relation to content areas. The times "reported on the 
questionnaires were, greater than given during the interviews, particularly fbr 
;> pre-viewing activities. Also, "even though some teachers, reported on the » " 
^questionnaire that they used THINKABOUT as a subject matt|r in itself, they 
'reported in the interview that 'the series -was used to supplement content areas such 

* ** • • 

as social studies and language arts. Most teachers though* even -though THINKABOUT* 
was not used as a part of one content area, tfce series was related* to or 
interjected with one or two content areas. 

Teacher Use of THINKABOUT / . , 

. During the 1979-80 school year, 24% of the grade 5 and grade e'teachers in 
Wisconsin used THINKABOUT. An .estimate of 26% of the grade, 5 and fcrade 6 teachers 
i& projected to have used THINKABOUT during' the' 1980-81 "school yeJr. .This figure- 
was computed using the 1979r80 figure and the' number of teachers Returning the 
postcard who had used THINKABOUT both years. '•• | ' 

'I 

The roost frequent reason g^iven^on the teacher questionnaire for using 
THINKABOUT. was the emphasis the series places on -reasoning, thinking, problem ' 
solving, and decision making. Another frequent reason was because the series shows 
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students how to deal with' life situations. Examples, of teacher responses when 



asked the main 'reason: fpr using tHlNKABOUT are:' 



/ • 



- frtfHINKABOUT) helps students reason and think about problems that occur, 
in everyday lite and what can be done about them. 

* • < \ 'V * 

- It leads children into # really thinking about many situations they coula 

•run into and some ways of handling them.' 

- It challenges the children in real situations that they face, ^-makes 
theia think ana not just absorb * ' % 1 

V 

Other reasons tnenbi6ned by four or more teachers were because stuqents enjoy the 
programs and t because the series stimulates discussion. Overall, teachers valueo 
the :>kilL> <that are* included in .the "series aou appreciated having them presented in 
an everyday life context that students enjoy viewing. 1 

4 - 

The decision to use THltoKABOUT was primarily that of teachers. Seventy- two m / 
' percent of the tea'chers reported' themselves as being the "most influential in • 
deciding Lo use THlNKABOUT, as well as 1'9% of the teachers saying that some other 
teacher had influence.- The ITV representative, was influential in only 7% of the 
cases. uach #o| the other sources, such as admi'nistra ? £brs or media spectcriTst, 
influenced no more than 5% of the teachers. . ' - * 

• One problem tor some teachers in, the use of" THlNKABOUT is that it is designated 
to be us,ed with two grade levels. Of the seven teachers who had used THlNKABOUT the 

0 ~t , , 

previous year and were not' using ft in 1980-bl, the main reason ior not using it was 

\ 1 ^ * ' ' 

because the students had already seen' the series. Most of these teachers .were 

teaching grade 6 or 5/6 as part ot a unit. One school has a plan to snow THlNKABOUT . 

. * •' , 

to' both fifth and sjixth graders, every two years. All of the teachers, who said some 

fc of their st'ude^its had viewed THiNKABOUT said they were planning i to use the series 

\ " . * - . ' ' ' < * - * 

next year. Only one teacher reported problems with getting equipment, poor recep- 

tion, and tune, conilict Using THlNKABOUT every other year is .how some teachers 
have dealt with having > THlNKABOUT available for both fifth and sixth 'grade students. 

feERJC . • 27 . \ - • ; 



On the average, teachers spent 48 minutes a week viewing THIMKABOUT and, aomg 
related activities. This time may be- slightly inflated based c&\ the telephone 
interviews. Most ol the teachers (66%) viewed two^programs a week. Nearly hall or 
the teachers spent from 5^10 minutes a week previewing the programs, whereas 
one- third did not do any previewing activities. The average amount of t.ime spent on 
discussion immediately following the programs was 12 minutes a week. Discussion 
was the mam follow-up activity and was engagea in by nearly all of the classes 
(88%). This corresponds to the view of some teachers that programs from the series 
were very good in. generating discussions. Two-thirds of the teachers aid not do 
any other in-class assignments directly related to THINK ABOUT besides discussion. 
The third o£ the teachers who did do related activities spent from 5-30 minutes a 
week on <the activities 4 . Thus, for one progranf, teachers generally spent 3 or 4 

minutes introducing it, 6-10 minutes discussing it afterwards, and very little time 

} 

doing any related activities. 

The activities that teachers did use varied and were generally related to those 
given in the guide. Seven of the teachers said^they do some form of discussion 
w.hen a situation arises in class, that is related to something from THINK ABOUT f ,or 
in helping the students* organize their thoughts. Six of the teaches said they* have 
their students do writing such as follow-up stories,^ reports, or papers. Other 
activities or materials mentioned by two teachers were posters, time capsule, 
Weekly Readers, role playing, follow-up projects, ana brainstorming. Activities 
mentioned by one teacher were stories, presentations, investigations, creative 
•writing, signing (sign language), patterns, advertisements, charades, mobiles, 
blockbusting', surveys,, cjames, paper airplane contest, and slide series. <, ^ 



. AboUt \J»a±£ oi the teachers had used all ol the programs^in the series. The 
average number of programs used by the teachers was 47. Time and scheduling 

* . - : \ . , : 



problems were most frequently given as reasons for not viewing all of the 
programs. Only two teachers, reported viewing programs on^CEty a week. One teacher* 
thought they were only broadcast one day a week and the other could only schedule 
them on Wednesday. One" teacher who only used part of the programs saict that the 
district had divided the programs according to content a,nd difficulty. The others 
who hau not used all ot the programs mainly experienced time or scheduling conllicts 
because of vacation or other activities. 

The main material used. along with THINKABOUT was the teacher's guide, useu by 

9 

70% of the teachers. The guide was rated excellent by 21% of the teachers ana only 
negatively by 3% ot the teachers. Suggestions teachers gave tor making the guiue 
more useful were to include run-on pages, some reproducible discussion topics, 

c 4* 

space after each program's material for jotting down notes, numbering programs, and 

.having pre-planned or ready-to-use follow-up activities. Only one teacher was 

critical ana- felt many (?f the activities were quite time-consuming ana had 

difficulty finding time for the activities. t>nly three teachers reported materials 

that they had prepared which included diagrams? booklets for -joal setting, posters, 

and worksheets; and situations from the atudents 1 day. 

Teachers*«did not express a great need^ for the supplementary material that was 

1 1 : » Lcu»— — wui kbook i» , duplicating masters, learnmg'games, ancl teaching posters., Over 

50& ot the teachers reported that these materials would be only useful or not « ^ 

necessary.- Less than 10% of the teachers reported that any of these materials were 

' ^/ 

essential. Most teachers interviewed felt they woula*not use supplementary 

\ 

materials because of the, problem of finding time to use them or the cost to 
purchase them. . 9 - I 
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Teacher Perception of THINK ABOUT * 
The overall Ya tinS o f" TH I NKABOUT by teachers was very positive/ with over 

4 

two-thirds of the teachers rating jhe series as~exceilent,„ the higHejt category on 
a five-point scale. Only 3% of the teachers had mixed feelings about the program 
(a. rating of 3), and none of the teachers rated the series below this level. 
Teachers' reported that their students reacted to TH I NKABOUT nearly, as positively as 
they did, with 93% of the teachers reporting a positive reaction from their 



students. 



THI NKABOUT had an impact on- classroom interactions. Sixty percent of the 
teachers agreed or strongly agreed that the programs aroused discussion in their 
classes. A slightly higher percentage reported that most of their"' students , 
participated in the discussions. Over^ two- thirds of the teachers brought up ideas 
from THI NKABOUT programs in teaching content areas. As. most teachers reported in 
_ the telephone interviews, THINKABOUT was uled in relation to or interjected with 

content areas such as language arts and social studies. Students were less .likely 
t b6 bring up ideas from the programs, but still nearly 50% of the teachers* reported 
-a - _£heip--students doing thil. 

\ Teachers perceived that THINKABOUT helped, at least somewhat, to improve 
students' skills On the 13 main thiriking stalls presented by the series. The 
series jf3s most helpful ia improving students' skills in solving problems. Fotf*'. 
this skill, a, third of th« teachers reported < the 'series was extremely helpful and 
56%- reported at least somewhat helpful. Other skills for which THINKABOUT wifs felt 
by "8 3% of the teachers «;<?.. be helpful fn improving were judging information, 
communicating effectively, using criteria, and collecting information.'. The skill 
that nearly one-tfrird .of the teacher s ofejt 
was estimatng and^approxiraating. No m6rd 




for any one of the skills that THINKABOUT 
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t THINKABOUT was^not helpful in improving 
than-i^% of the teachers, however f said 
was not at a.11 'helpfill. 

30 



Teachers were less /positive in rating the success of THINKABOUT in meeting its 
goals than they were in assessing the degree to which the series was helpful in 
improving thinking skills. Generally, 'less than half of the teacher s *ra ted high or 

.very high the level o£ THINKABOUT 1 s success in strengthening the ability of students 
to be problem solvers and independent learners, or the four characteristics of 
these abilities—effectively expressing themselves, managing their own learning, 

^ reasoning systematically, and thinking flexibly* From 30%-52% rated THINKABOUT 1 s 
success as high, 28%-46% as neutral, and 5%-12% as low. Strengthening 'students 1 
ability to be problem solvers was rated higher than strengthening their ability to 
be independent learners, *52% positive, responses 1 compared to 43%. The success of 

c 

THINKABOUT to strengthen the abilities of • thinking flexibly and reasoning 

( " ' - 

systematically, both rated positively by 46% of the teachers, were rated the 

highest among the four characteristics, ' followed by effectively expressing 

themselves (43% positive responses), and managing their own learning (31% positive 

responses). Effectively expressing themselves had the highest average "rating (3<5" 

on a 5 point scale)- of the four abilities. * . * *. v 

The positive feelings teachers had toward' THINKABOUT strengthening , 

problem-solving skills may be partially related to the popular ity -of programs. The 

three programs liked the b'est by the most teachers are- from *the Problem Solving* 

Cluster—programs 57 ("A Matter of Timfe") , 58 ("There's Always a Risk"), ahd 59 

( H Hanging in There"). , These -programs are a three-part serial and Were among the 

most recent programs viewed prior to teachers completing the questionnaire/ which 

rrtay account ^for some of their pqpularity. Other programs that were rated by three 

or four teachers to be among the best program were programs 56* ("One Thing Leads to 

Another* 2 .("Brainstorming"^ , and 17 ("Where Should I Go?"). The one program 

rated among the worst by the largest number of teachers, eight, was program 60 



{."Plan. a City of the Future"). Other programs which were the least favorite of two 
or throe touchers wore program 30 ( "Checking Conclusions") , program 23 ("There are 
Many' Ways, to Go 1 ') , and program 55 ("Making Something New"). Three of the four 
mentioned most frequently as the worst are tip and challenge programs. 

y Teaches agreed very little on the best and worst programs Qtner than those 
mentioned above* Thirty-six of the GO programs were rated among the best, while 27 
piotjicimi; won* rated among Hie worst by at leuct one teacher. A large nuinbet ol 
f&ograms appeal to teachers in different ways. The variabrlity in appeal suggests 

tht> ^programs in the series have some diversity. 

*> * " 

Many of the teachers, 32 of the 58 teachers who completed the questionnaire, 
reported some of their positive experiences with THINKABOUT. The most common 

experiences were with/<jood class discussions, high 'interest level of students, ana 

/ 

what stiidents learned from the programs. Some of the comments ol w teachers were: 

- Several times skills presented related direct!^ to skills needea that 
very day or week in some social studies work. It made for very 
effective application. Exciting ! , 

- Holds student interest — plots r 

• - Gcfod discussion t * • " , . . , 

- Carry-G^er Value ifito other subject matter; student eagerness to view 
program ^ , t 

- They have motivated good discussions. 4 



- Group felt the "Conununicati^ng Effectively" series was very good, seemed 
to have~ good results with students also. • 

- The kids picked up problem solving on their own, 1 

Other experiences thaUrwe^e given, but not as frequently as the three types 
above, were' good examples 6r presentation of concepts, helpful with teaching, 
and -relevant to students. Some o£ the teachers* comments were: 

- .'itudcnU; cdn relate; to tii ttuit ions 'ajid character;; oi tlA; program 
They look io'rward to seeing it 



1 



- It reaj-ly illustrates* concepts In an exciting manner to students. \ 

- They always* seem to relate programs to" their own experience. 
* ♦ , 

Only ten teachers (17%) identified some negative experiences , with the 

series. Three ot the teachers fejt some frustration because ot not having 

enough Vime to do the LolJow-up activities and to use the~series as 

effectively as it could be-/ "Not enough t-une in dailyschedule to^proviae 

ample opportunities to apply skills. Pupils should have time to see skills 

that work tor them in settings similar to what programs showecu" Two teacrters 

expressed a lack oi student interest in some of the programs. 'J wo other 

teachers expressed some stigma against watching television. "None, except 

that 1 have trouble convincing our administration that this program and_other 

TV programs, havp value." One teacher felt that the program on risks iett the 

» 

students hanging. Finally^, one teacher was less enthusiastic with the program 
4urinq the second year. "The second year 1 used THINKABOUT it was less 
ef f ective--mostly because it was not (the) first time "with me as the teacher, 
so. ..less enthusiasm, les-s association, less effective use of content. Next 
&ear I plan on using some other program, just for variety . f I will be teaching 

* e 

the- Skills approached # by THINKABOUT, but in a different way." 

Over half of the teachers took the tune to write down some ot their own 
continent:,. „All oL these comments wcte very positive except lor, one teacher who 
felt* the questionnaire was too, long. -A random sample of five of the comments 
are given below. # Jh s , 

-♦The examples were of daily experience that ^ chila might experience.' 

- Good program for teaching kids to organize thoughts and days. . * 

*** * 

- I Leel your program has been* a gooa motivator in class discussions. 
My ^students have been* able to identify with- the actors and actresses 
on your program. ' • 



V 



, • - -28- * 

» s » * « 

- I wish there were about six more programs so that THINKABOUT would 
continue until June. 

- I really hope the program will continue, s * , 

Teacher In-service ' • 

Not a large number of teachers were interestea in. a THINKABOUT in-service 
' or fathering of teachers. Only 29% of the teaohers said* they would be 

interested in meeting with other teachers who usje THINKABOUT from their area, 
and 38% said they would like to have an in-service on THINKABOUT. Of the 
comments wiitten by tne teachers about what could be done to help them more * 
effectively implement THINKABOUT, provide more tiijte was given' the .most 
•frequently, six ot th? 24 comments. Three oi the* teachers askeu tor an 
in-s.ervice and two suggested activities for each progreun. Other suggestions 
included having more* information on the programs, having mor^ student 
materials, and having duplicating masters. One teacher would like to have new 
programs each year, % or at.<£east to have two sets that # could be shown pn 
alternate years. Of the. eight responses to what would be a good time tb have 
an in-service, most mentioned a time 'directly following school or on 
in-service days. * N 

t .Stud en l P o r c e p t ion « • - - s 

Problem solving, as for the teachers, was perceived by the students as the 

arcu whore THINKABOUT had been the most help. However, on the questionnaire 

completed by 29 students, students distinguished between THiNKABOUl' neip,tng . 

them with the process of solving problems and solving pftoblems on their own. 
* jover three-quarters ol .the students agreed or strongly agreed that THINKABOUT, 

helps them to see more than on-e way to solve a problem, 'come up with new 
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ideas, and learn" better ways'to solve problems. .Whereas when asked if ' 

THINKABOUT has shown them now to solve problems on their own, less tnan hall! 

of the students agreed. - M }st students also did^rioT^a^ree^that THINK ABOUT 

helped thcyn to say better ^jjat they wanted to say. 
*' » • • . ✓ 

Most students liked TH (NK ABOUT very much. Less than one-quarter of the 
\ , * _ - ~ 

.students Wfert? eithero indecisive or negative towards the sines. The most 

popular programs of the students were programs 58 ("There's Always a*Risk"), 

< 

57 ("A Matter of Time"), 56 ("Ore Thing Leads to Another V) ana 2 

("Brainstorming"). These are nu.ny of those liked the best by teachers\ -The 

deast popular programs ol the .ituuents were programs 36 ("Where Do You Finci 

Them?*)', 5 ("Estimating"), 60 ("Plan a City of the Future") 33 ("Plan Aheaa" 

and 51 ( "Planning # Presentation"). As with the teachers, a large number of 

programs were selected at least by a few students as either the ones'most 

* ♦ ** 

* * 
,liked or the one least likeu. 



Group Response Analyses on Four Problems 

The responses to the four interview problems were analyzed to identity . 

Till I(>M-ucf.*:7 between "TIlINKAfiOUT" stuuorits (users) and ndn-THlNKABOUT 

students (non-users) on three ot the four qualities of problem^sol-ver s and 

* * 

independent learners — reasoning systematically, management o£ own learning, 
and flexible thinking. Evidence of the fourth quality, effective expression 
was sought in the analysis of the group protocols rather than in the 



responses. The scores of the responses on the four problems for each class, 



c^^a 



users and non-userJfc ; are. given in Tables 4 through 17.. Tables^ and 3 show 



the average time spent by the groups from each class sol'virfg the problems. 
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The amount of time spent by the groups solving the problems indicates that 
students were interested in the problems ana that the problems were pot 
trivial 'tor them (Tables 2 and 3). However, none ot the groups spent ail ot 



t^as 



the 60 minutes , that^yas allocated to work on the # problems . *lhe yiine spent 
ranged from 4-6 minutes on problem 1, from 4-8 mijiu^s- cfn proolem 2, from 
18-23 nnnuteo on problem 3, and from 11-15 'minutes on- problem 4. 

• * 

Moct ot the groups of students,- users and non-users, had' di f t iculty making ^> 

inferences unu drawing conclusions, botn faceCs ot reasoning systematically 

On problem 1 (Tables 4 and 5) students generally understood ^the conditions of 

the problem and £rieu 4 sbme means ot solving v ti)e, problem, such as drawing a 

figure and tLial and eiror.- The students did 'have more difficulty*' in drawing 

un appropriate conclusion or giving an appropriate rfeason. On problem 2, 

* w 4 _ 

students had difficulty analyzing the similarities and differences between two 



situations 



and then^iaking a conclusion. All glasses scored low on problem 



2. The scokes were nat> consistent enough between users* and non-users on 
problem l c and 2 say tnat there were any •dittgrences between ( the tw© groups -o 
in their means of solving the problems and in -their Ability to make inferences. 
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Tabli 2 N * 
Average Minutes Spent on Problems by Class 
Grade 5 
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v 

j 















0 






THINK ABOUT 


Classes 




Non-THINKABOUT*Class 


Problem 


115 fl 


215 




Grade 
Mean 




, . 315 


1 


4 


5 




4.5 




6 


2 ,. 


7 


4 




- 5.5 






3 u 


19 


20 




. 19.5 




. 8 ' \ ■ ( 

\" - \ 


4 

« 


13 


15 




14.0 




— V \ . 


Total 


• 43 


. 44 




• 43.5* . 




50 




\ 

\ 


V 


V 


> 

✓ 




• 

4 






9 Table 3 
Averag-e Minutes Spent on 
Grade 6 


Problems 


by Class * 

\ 






THINK ABOUT 


Classes 




-Non -THINK ABOUT Class 


Problem 


126 


136 


226 ( 


235/6 , . 


Grade 
Mean 


326 



1 



















1 


7 


6 


6 


~~ 6 


6.25 T 


. * 5 




2 




4 


5 , 


- \ 5 


6.25 . 


- 4 




3 


?1 


21 


* 18 




20.75\ 






4 


11" 


_8 


14 


15;^ 


12.00 


12 

o — 




Total 


— *U 


39 




: 49 


45.25 


37 








s 














4 i 


1 






; \ 


'"4"V 
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Table 4 ^ 

Mean Class Scores on Problems 1 and 2 for ^fcade 5 



Problem 



THINKABOUT Classes 



115 



215 



Grade 
Mean 



Norr-TH I NKABOUT Class 
* 315 



Problem 1 
(10 possible) 

Problem 2 . . 
(3 possible) 



5.67 '9.33 



1.00 



.67 



7.50 



.83 



8.33 



.33 



Table 5 

Mean Class Scores on Problems 1 and 2 frfr Grade 6 



Problem 



THINKABOUT Classes 



126 



136 



226 



235/6 



Grade 
Mean 



No n- THINKABOUT Class 
326, 



Problem 1 
(10 possible) 

Problem 2 
(3 possible) 



7.67 ■" 8.67 7.33- 7.*67 



l.*00 



.67 0.00 



.33 



7.83 



.50 



5.33 



1.00 



Slight differences were noted between user £nd non-user classes on facets of 

\ m 
managing* their own learning. On problem'' 3 , some sixth grade users sequenced their 

responses in planning for a school radio , station, whereas none of the groups of 

sixth grade non-users did (Tables 6, 7, 8, and 9). On problem^, page 4^the user 

groups cfave as^ptfny or more strategic responses .than did the non-user group (Tables 

14 snd j<5) . Strategic responses reflect jtl>e overall planning, systematic appproach, 

and organization of a task into manageable pacts* jfrhis is contrasted! with the 

second type of responses, tactical, whicfc are concerned with specific details of a 



project. 
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Tabled 

Class Scores on Variables for Problem 3, Pag,e 

Grade 5 



Tactical 
Strategic 




Scope & dimension 
(3 possible) 



Information 
(3 possible) 



Resources & equipment 
(3 possible) 

Sequence of steps 
. (j possible). 



. 0 * 



• 5 



V 



Table 7 

Class Scores on Variables for 

Grade 6. 



( 

Problem 3, Page 1 \ 



Variable 



THINK ABOUT Classes 



126. 136 



22.6 



235/t 



Grade 
Mean 



Non-THINK ABOUT Class 
326 



Tactical 

Strategic 

Scope & dimension 
(3 pos/sible') 

Information 
{f possible) 

Resources & 
equipment 
(3 possible) 

Sequence of steps 
(3 possible) 



4 
3 
T 



;9 
3 



6.50 
6.75 
3.75 

2.00 
.50 



5, 

3 

1' 



0 .. 



0 - • 



.75 > + 
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* t 










* 




•% 


















Table 8 










Class 


Scores 


on Variables for Problem 3, 


Page s 2 » 










Grade 5 




/ 


* 


Variable 




THINK ABOUT Classes 




Non-THINK ABOUT Classes, 






115 


215 


Grade 




315 










.Mean 




• 




• 

Ql Information 


2 

» 


* 


3.5 




4 




(15 'possible) f 




















Jf 






Ql Equipment 


13 




11,5 




ii \ . 




(15 'possible* 












Q2 Resources - 




> 

8 


8,0 








• ' (15 possible) 


























' \ 


- ^ Q3 Decision steps 


0 


0 , 


0,0 




5 




(15 possible) . 










• 




Q3 Sequence 1 


0 


0 


0.0 




1 





Table 9 " 

Claps Scores on Variables for Problem 3, Page 2 

grader 6 * 1 



Variable 



THINKABOUft Classes 



Non-THINK ABOUT 



ERLC 





126 


136 . 


226 


235/6 


Grade 

Mean • * 


-326 




% 

Ql Information 
(15 possible) • 

• 


4 


4- 


7. 

•• 


7 


A . # 

5.50 

• 


1 


• 


Ql Equipment , 
(tl5 possible) 1 


* 1 


9 


8 


*~ 3 


5^25 


1 

\ 




Q2 Resources - 
U5 possible) 


5 


9 * 


14 


10 


) ' 9.50 g * 


10 * 

*** 


t 


Q3 Decision steps * 
(Impossible) ' " . 

*' 


7 . 


7 . 




9 


6.25 

r 


7 




Q3 Sequence » 


1 


1 


1 


2 


1.25 






» 

• *' » 






• 




— t ; 

40* . 


* 





"Thte difference's between user and non-user groups on* these variables were 

r 

particularly noticeable for the "grade 5 groups (Table 14) , where the user cjroup 1 

\ . * 

gave. many more strategical responses. Another indication suggesting that the 

f * , 9 / 

s£ undents from user classes^ might be better able to manage their own learning,, was 

♦ * » 1 • 

the number, of responses of working harder on problem 4, page 5. Students were 

i • » ■ 

confronted with Jim's problem of suddenly finding out that the science fair 
deadline was soorver than he was told, and they were to generate ideas of what Jim 
could do. At least one or more groups from each user class gave a ^response about 
working harden (Tables 16 and 17). Oily one- group from all of the six non-user 
groups, two-^classes, gave such a response. The moat frequent response of the 
non-user classes was to reduce the Iscope of the project' in some way. ^ 

■ Although, there was some evidence that the THINKABOUT classes gave more 
strategic responses than the nort-THINK ABOUT classes, the evidence was not without 
sora^questions.^ On problem 3, the fifth grade non-user class gave more strategic 
responses ^han.did either of the user fifth grade classes (Table 6), and more than' 
two of the user sixth grade classes. Problem 3 is more tfpen ended and de^ictfe a 
situation that; is^not as realistic as problem 4. More creativity is required for 
problem 3. One possible explanation is that THINKABOUT groups may be better able" 
to plan and be systematic ^in a more structured and realistic situation than in a 

more open-ended situation." • • 

> '» * * . ' . 

The THINKABOUT classes "showed jnore flexible thinking on problem 4, page 3, than 

* i * 

did th e ^no n-.TH INS ABOUT classes. On this page^groups were asked to list sources of 
information for finding out when the fair deadline, is arid where to get infprmation 



on spacecrafts. THINKABOUT groups at both *jrade levels gave more other .ideas such 
a^ ^sk/ng a scientist or writing to NASA to get information about spacecrafts than 
did the non-THINK ABOUT groups (Tables 12 and 13) . On this question THINKABOUT 



groups gave more of a Variety of resjaonses. Contrasting this with the creativity 
shown by the fifth grade; non-THINKABOUT class oh problem 3, the THINK ABOUTj classes 

showed ;more oi? a breadth in responding to problem 4,, page 3, whereas the fifth 

< - ' t • 

grade non-THI NKABOUT class on problem 3 showed more depth. j 

The group responses on the four problems point to some possible differ^ncgpT 
between the THINKABOUT classes and the non-THINKABOUT classes. The differences 

: • " % ' \ • i 

suggest that the THINKABOUT students may be more adept in managing their own 

% l 
r # . ■ k 

learning, because of evidence of sequencing steps, listing strategic responses to a 

realistic situation, and working harder when faced with a time constraint. 

TH-I NKABOUT classes also showed a little more flexible thinking in identifying a 

variety of sources of information. The differences were not always clear-cut , 

particularly since in a more open-ended situation groups from one non-THINKABOUT ' 

class listed mope planning, strategic responses than did most of the THINKABOUT 

groups. All, groups from both types of classes had difficulty making-inf erer ces. 



• . L Table 10 

Class Scores on Variables for Ptoblem 4, Page 2 
Time Deadline and Peopl'e to Help 
» Grade 5 



Variable 

Deadline/ time 
People to help 



THINKABOUT Classes 



Non-THINKABOUT Classes 



115 

2 
0 



215 

t 

2 



Grade 
Mean . 

1.5 
v 



315 

I 
1 
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Table 11 

Class Scores on Variables for Problem 4, Page 2 
Time Deadline and People to Help 
Grade 6 



Variable 



THINKABOUT Classes 



126 . 136 



226 



235/6 



Grade 
Mean 



Non-THINK ABOUT Classes 
326 



Deadline, 


time . 0 1 


2 


— v- — 

r \ 1.00 


1r, 


1 


People to 


help 1 0 


2 


0 \ .75 


\ 


2 






Table 


. 1 

12 








Class Scores 


on Variables 


for Problem 4, 


Page 3 






Information Fair 


Deadline and 


Information on 


Spacecrafts 





Grade 5 



/ 



Variable 




THINKABOUT Classes 




* Non-THINKABOUT Classes 




115 


215 • . 


Grade 
Mean 


315 


Fair Deadline 


School staff 


2 


2 


2.0 


2 


Parents, relatives 


0 


0 


. 0.0 


o 


Fr iends, classmates 


0 


2 . 


r.o 


3 


* 

Fair staff 


2 


* . 2' 


2.0 


1 0 ^ ' ' 


Media 


3 


1 - * " 


2.0 


2 . 






Spacecraft Information 







School staff 
Parents, Relatives 



Fr iends, classmates 
Printed material 
Ofcher ideqs *_ 



0 




0 


0.0 


0 




0 


0.0 


0 




0 


o.d 


3 




* • 

3 i 


3.0 


3 




4 


3.5 



0 
0 



0 
4 
2 



] 3 * Tabltf*13 

Class Scores on Variables for Problem 4, Page 3 
Information |m Fair Deadline and Information' Spacecrafts 

- q Grade 6 















» 


Variable 






ThinkAbout 


1 ?— 


• Non-THI NKABOUT Class 




126 


. 136 


'226 


235/6. 


Grade 
Mean 


326 


Fair Deadline. 


School stfiff 


0 


'l ' 


' 2 


4 


\ 
1.75 


0 


Parents, relatives , 


0 


0 


, 0 


0 

• 


0.00 . 


0 


Friends, classmates 


0 


0 


1 < 


1 


.50 




Fair staff 


3 


1 


* v o 


0 


2.00 

« 




Media 


2 


o". 


■ 2 


• 

1 


1.25 


1 ' 



Spacecraft- Information 



School staff 


0 


0. 


0 


" 1 


.25 


\ 






Parents, relatives 


< > ; 




' a 


*L 


.25 




' 0 




# 

Friends, Classmates 


0 x 


* # 

, 0 * 

A 


0 


0 


0,00 




0 




Pr inle^ material 


3 


3 


• 4 


6 


4.00 




4 




Other ideas ** * 


3 


4 


* 1 


2 


2.50 


• 


i 

0 


4 
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Table 14 

Class Scopes on Variables for Problem 4, Page 4 
Steps in Jim's Plan . ; 
Grade 5 



Var i able . • 




THINKABOUT Classes 




^ Non-THINKABOUT Class 




115 




21^ 


Grade 
*Mean 






Strategic Variables 


Scope, dimension 


2 




3 


2.5 




2 • 


Information, advice 


; -l 




0. 


• 5 




0 " ' . 


Assemble resources 


4 




4 . 






1 


Global statements # 


2 




3 


. 2\5 




-1 • 


- Subtotal 


~9 




f 

10 


9,5 


t 


4 


-\ 




Tactical Variables 




< 




Construction 






1 


* 1.0 


I 


8 «. 


Painting 


4 




'3 ' ? 


3.5 


3 


Other ideas 


2 


* 


3 " ; 


2.5- 




* 

JL ' 


«• 

Subtotal ' 


1* 




. 7^ 


7.0 




11- . 




9 


■ „ r 

* 


Order 




> 

















—\ 


Order " • * 


3 




3.0 


i;^3 

















- V 



45'- 



■I 
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Table 15 ' 

y Class Scores on Variables for Problem 4, Page 4 
Steps in Jim's Plan 
Grade 6 



Va^i abl| 






THINKABOUT Classes 




Noil- THINKABOUT Class 


126 


136 


-22$ 


235/6 Grade * 
Mean 


326 " # 








Strategic 


Variables 






Scope, dimension 


'4 


3 


» 


4 


3.50 


3 


Information, advice 


0 


1 


0 


0 


* ,25 


• 0 


Assemble resources 


, 3. 


2 


4 


^3 . 


3.00 


2 * 


Global statements 


2 


3 


/l 




1.75. 


3 


Subtotal 


9' 


9 


8 


8 


8,50* 


' 8 



Tactical Variables, 



^Construction* * 2 4 *2 6 

Painting 2< , 2 2/ 3 

O^her^deas * ' 1 2 @ , *l 



>3.50 
2,25 
1.50 



2 
2 



V 1 



Subtotal & 


6 io 7.25* 


6 








% • \^ 


t 

Order 1 




















* 


Order 3 / > 


3 3 -aC(to ' * 


3. 








«^ > 






1# 




> 



0 



»0 



Table 16 [ t 

Class Scores on Variables s for Problem 4, Page 5 







Meet Approaching 


Deadline 








Grade 5 




- 

1 


Variable 




THINKABOUT Classes 


• Noh- THINKABOUT Class 




115 


• 215 
* 


Grade 
Mean 


315 


Work harder* 


3 




t 

2.5 


1 


Give up 


* 1 


0 


• 5 


• a 

f 

* * 


Stop & salvage 


• o 


o 


0\0 


.0. 


.Reduce scope 


3 


2 

* 


2,5 . 


.7 


Postpone deadline ' 
Get- help 


0 

2 


, 0 

4 

2 


0*0 

* ' 2,0 


0 


Other ideas • « 


0 


0 


0.0 


0 * * 


Total 


9 


6 


7,5 


• 

* 10 



Table 17 

Class Scores on Variables for Problem 4, Page 5 
Meet Approaching Deadline 
, Grade 6* 



Var iable 



THINK ABOUT ^Classes 



Non-THINKABOUT Class 



126 136 



226 



235/6 



Grade 
Mean 



326 



Vfork harder 
Give up 

Stop 8^ Siilvage 
Reduce scope 
/Postpone deadl±rce~ 
Get help 
Other ideas 



1 
G 
0 
0 
0 

1 

0 



2 
0 
0 

, 7 

— o- 

3 
1 



3 
0 
0 
1 



1.75 
0.00 
0.00 
4.25 

otoo- 



1,75 



.50 



0 
0 
0 
7 
0 

i 
o 



Transcripts made of the groups* discussions as they worked on the four problems * 

were analyzed by identifying processes and procedures used by each group that would 

* 

fit under any of the four general characteristics of an independent learner — group 

interaction, management of own learning, reasoning systematically, and flexible 

thinking. Each transcript was read and examples of the processes noted. Then the 

processes found to be used by all of the three groups from one class were labeled as 

common processes for the. class. These were assumed to be characteristics of the 

class and to be partially th^ result of a common experience, such as vdewi^c} • 

•# ■ 
THINKABOUT, * , 

The mostt apparent difference was that the groups from the THINKABOUT classes more 
( C - • . '. 

freely expressed their ide^s to the groups and engaged in a dialogu.e than did the - 

•\ * 

group? from the nort-THINKABOUT wLasses* In' the THINKABOUT groups, students wou],d 
occasionally a£k questions of 'the' O group, discuss the ideas gitfen by another member, of 
the group (particularly sixth graders) / and occasionally of fer some form of> evaluation 
^of the ideas. Th«is happened very infrequently in the norv^THINKABOUT groups where 

- » o 

the^e was little discussion ando-the work was either done as individuals or by only ' 

two or three group members. \ 

'] \ ■ ' ' ^ * 

°To. illi^trajie the difff erences^in the type of discussions that occurred in many 

THINKABOUT groupS and in nearly all ao n-TH INK ABOUT groups, parts of ' the protocols of' 

all of .the non-THINKABOUT . groups and one randomly selected THINKABOUT group from each 

grade level are given as Figures. 1-4'. The question— problem 4, page 3, questiorf 2— 

asks the,£roup to give ideas about how Jim. might find out more about actual spacecraft 

> * / b . * 

, so, his model will loo ker eal . Ifr e responses of the non-THlNKABOU^ groups ,„ Figures 1 . 

and 2^are short, lack Variety, and were genera ted" generally by "oi^Ly one or two of 

the students.' The protocols of the two THINKABOUT groups, Figures .3 and 4, are much 

longer in lerfgth than any of the non-THINKABOUT protocols, and show inter-actions 

between the group members that was not apparent in .the non-THINKABOUT .groups. . * 



-4.3- 



315 Gl 



315 G2 



315 G3 



"Go get a book." 

"Science book or else encyclopedia. * 

^Books, designs" 
"lx>ok in books. " 
"U.S.A. " 
"Designs" 

"Oh, you mean the designs on the outside of the 
rocket spacecraft." , + 

?Yeah." < - 

.'"Pictures" 

"looking at the outside of a rocket. They have 
to know what they should put down." 

h Jtook in the encyclopedia or get a, book." 
"Yeah, book or encyclopedia." 

". t ..or even look at a model that he° has <S* one of 
his friends has." 



- Figure 1. "Protocols of grade 5 students from V 
no n-TH INK ABOUT .class 315 responding tq problem 4, page 3, 
question 2. Gl, 2, »and 3 designates group. 



v 



r 



326 Gl "Look up in' encyclopedia ." 

Pause as one person writes the answer. 
Another Student rea$5s what was written and tifien 
.^rdfrp gpes on. 

t ■ < 

\ 326 G2 "Gets some. books, sjfcace books." 

0 Pause 

"How to spell?" * 
"How to spell?" 
"Close enough" " 



r326 G3 "Look up. rockets- in encyclopedia." (student 1)^ 
. * "That's all I can think of." (student 2). 1 

"Or else you can go to a museum." (student 1) " 
"What if it's^ a Tew hundred miles away?" 
(student 2) ^ 

."Yeah, .that 1 s enough. " (student 1) 

" » * _i i 

. • - . 1 

Figure -2. - Protocols of grade $ studeats' fjrom _ 

non- THINK ABOUT class 326 responding tp problem 4, page 3, 

question 2\ Gl, 2, and 3 designates group, 
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115 G3 n Hro. • .ask." 

"In a science book," 
r "No, read- a lot of books, " 

"Yeah/" v 

"We can have several answer s-. read books," 
" "Wait. . .wait. . .hm." 
' ^pon't put it down." 

"No, wait." \ - 

"The books" ' „ . J 

"♦..do research. 4 . ' 

"lhat's books, ok.. .ask people." 

"Go to actual site, you know, I mean pf the 
* rocket'." N , ' * * , 

"Ask Sharon." - j 

"Oh yes. Where vould we go aroupd hejfe?" 

"I, want to say sometj^ng. I want to go to New 

York and see..^ 5 

"Y.eah." 

"Hey" , ^ 
"If ^scyneone has a rocketship, asK the™." 
"Ask' astronaut. I didn'fsay to ask people or 
anything . " ♦ 
"What else?" ' % • ? . • 

'"That's all\" j, ' , ^ * • 

Figure 3k : - Protocol; of >ane tj£oup of qra4e 5 students »f rq;ih 
THINKABOtW clas$ 115 # rf ^pnd'irtg Z<3 jpro^Jpi ^/'page 3, 
question J. G3 designates grpup^ ^ , > 



'Oh.%* 

* ^ a 




226 Gl "Where would we find out information to make 1 
look real... the encyclopedia.*" * v 
"Encyclopedia." ^ ^ 

* "They haye lots of spaceships.." 
"Go to. . ." 

"How do you spell it?" v 
■ "E-n-c-y-c-l*-o-p-e-d-i-a" 

"He could go to a hobby shop." 
"They launch one every month." 
"If you Ipok in science fiction books they have 
lot.. ." f / * 4 

- "Yeah" * 

". . .pictures." * * * 

* *R^erence -books." 

"Well* science^f iction they have 
spaceships and things, ^^Seorge, 
about it." » • 

"Spaceship book." 
J!Well, that's science fiction." 
I * "He can lool? in the -book Cosmos! 
. ' *WeH, that's probably.. \" 

"That's a science fiction* book. " 

"Well, that's probably enough." . 

"That shows spaceships that shows three or four. 



'lots of 
don't worry 

G 

Cosmq^iSi** 



Figure 4# Protocol of one group of grade 6 students from 
THI-NKABOUT class 226 responding to problem 4, page 3, 
question 2. Gl designates_aroV£ 



Many **^hjiri king skills and processes are associated with the management of one's 



owj* learning. For indication of this quality of independent learners, evidence was 
sought of planning, gathering and generating information, transforming information . 
into Another form, questioning , ^^Vithesizing information, drawing conclusions, 
evaluating information, perseverance, and redirection to the task at hand* Air of 
the thirteen thinking m . skills presented in THINKABOUT are related in one way or the 
other with management of learning* 

Few differences were observed in the protocols that would support the fact that 
the THINKABOUT classes could manage their own learning better than the no n -THINK ABOUT 
classes. Many of*tte* characteristics were rarely observed in any cjroups such a-s 
checking, redirecting 'thergroup, perseverance, listing alternatives, varying 
conditions to a problem, and restating a problem using their own words. Othjsr 
characteristics were observed as frequently in non-THINKABOUT groups as in THINKABOUT 
groups such as considering a plan, seeking information from people using surveys or 
polls, considering an analogous situation, ^making inferences, and reshaping 
information by using diagrams. * * . . > - - t 

The one difference that could characterize more of the THINKABOUT groups than t^e 
non -THINKABOUT groups was _the clarification of icieas or building upon the idea given 
by another member of the gfoup. On$.y one of the six non-THINKABOUT groups was 

. " - i V ' . 

observed doing this, whereas><jearly a half of the THINKABOUT groups were bbserved 

*A ■ 

clarifying, noting errors, or, ;omm^nting on the ideas of others. Frequently #1 the \- 
comment would be prefaced with "Yeah, but...* In contrast, .the.non-THINlCABOUT groups 
usually accepfeedTSMeas as they were giv&n without discussion or advancement f Figures 
5, 6,' $na 7 provide examples of groups building upon ideas of one member. Figures 5 



and 6 ar^ protocols-^of THINKABOUT groups.^ Figure 7 gives a protocol from a non-THINK- 
ABOUT group that illustrates one of the rare^times that one of these groups built upon 
ideas of others in. the group. Building upon ideas of others in* the gjroup was observed 
only* on t an occasion in any group, but almost never in the non-THINKABOUT groups. 
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215 Gl - Deciding on what should be broadcast: T * 
' ^ ". . .educalTlfenal stuff." 

"You're learning something. " ■ * 

. . "You could listen to educational stuff and music. 

"But you are already at school learning 

eduGational stuff." ' ; | 

"V&at's the use of, learning it on the radio?" - 
pause 

"You probably. . 

"Something that's going on around the school." 
-^"Yes, you want to have someone stalking about 

what's going on... and say like. . . t*his week we f ^ 
have the basketball team.%." 
"Yeah, you could tell the sports.." 

Figure 5. Protocol of one fifth grade THINKABOUT group, • 
215 Gl, for problem -3, page 1, showing one member building 
on the ideas of another member. 



126 Gl Deciding how to plan for a radio station: 
"Fioy#about news?" 

"Think about what they do on a r-adio." 
"Can't do this. > Have to have what people ltke." 
"Hafve to plan out; what is education, like, what 
they have on TRADE-OFFS." 

"They have to decide what programs are to be ^ 
aired, go let's just think of-some." 
, "Education, news, or weather .. .what else can we 
* , do?" ' 

4 "You are not answering the question. It says 

what you* would dp to plafl." 
"■*Tb plan go around to* ask people questions. 

That's how you would get started." ■ * 
• "How would you go about doing it?" ^ 

"Oh/* I get it*" 

"How f about taking a survey?" 

Figure 6. Protocol of one sixth grade THINKABOUT group** 
126 Gl, for problem 3, page 1, showing how one student 
notes misdirection of^'group. 

? ' ~" \ . 

326 Gl Things, to' ki\ow in order to set up a plan: 

"He.woul4 need someone else because probably 
/doesn't have enough time to build it 'himself .," 
*H6ve to epk someone ," 
7 /Like%is daddy." 
"I 'doubt i*f hismom will help." 
"Maybe* he- wouldn't have a dad?" r . * * ' 

"Get someone else." * * \ 

** r 
Figure 7. "Protocol of one sitfth grade non^ THINKABOUT 
g^oup, 326 Gl, for problem 4^page 2,' showing V°V on^ 
student builds upon ideas of another. 
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j. The charaeteristics for systematic reas^iyg that w^re sought in the protocols 

\ - . /«*~ 

i ^ were planning, using criteria, noticing details", judging information, making 

r \ * * . 

-inferences, considering alternatives, searching for patterns, noting the conditions 
of the problem, and evaluating responses. As w^th managing their own learning,, 
these characteristics are included in the set of the thirteen thinking skills of 

1 the series. . • 

* » 

. « Very few differences in systematic reasoning' were obser-vecLJ-ri the protocols of 

th^HINKABOUfT *nd non-THINKABOlTr classes. ''GrQuJSr front' both types of classes \ 
considered forms of planning, considered criteria, an<3 noted conditions of the 
„ " problems^ Some of the criteria that were suggested to be used^were teachers. 1 

opinions, t time restraints, and student opinions. Groups from both THINKABOUT and 
non-THINK ABOUT classes misinterpreted problems and had difficulty reaching a ' * 
conclusion. Almost none of the groups looked for alternatives or evaluated » 
information. s ' . 

No differences were found between THINKABOUT and non-THINKABOUT classes in 
. ? ^ beginning work on problems w;th general "ideas ra.ther *than with specific details. 

Part^of^reasoning systematically 'is having a general outline or an idga of what " v . 

direction woul0 be most helpful. In starting problem 3, planning for a radio % 

* * * / k 

station,, 50% of • THI hftC ABOUT groups as well, as 50% of the non-THINKABOUT groups began . 

by listing specific ideas such as types of programs or types of equipment. The ? " 

• . * * ? * : ^ 

Oth§r half of the groups began by talking about steps in* planning . As the groups 

responded to the questions, a tfiird of them gave specific* details th^t could* be\ 

• . considered in planning, <euch as the nee^/for a means to get Jim\s spacecraft to-the 

r . ^ — \— _ — — — , r - c 

fair (problem 4) or scheduling programs for kindergarten children on the radio 
station. Thus, different groups of students were more'^systematic in their reasoning 
and procedures to solve the problems than other groups, but the more systematic 
gfoups were not just restricted to THINKABOUT classes,. ) * 

emc ; •; . .. . . ~ - \ ■ 



The rn^irv characteristics 4 gf thinkirig flexibly that were sought were the 
consideration of alternatives/ the generation of ideas .(brainstorming)*, and* the use* 

4 * 

of criteria. No characteristics were observed in^ the protocols that would indicate 

that THINK ABOUT classes thought more flexibly than the non-TH INKABOUT classes. 

Very rarely did any groups consider alternatives. The non-THINK ABOUT groups used * 

: . I ' 'V 

Criteria or rated Some form of a^criteria in : the same proportion as. the THINK ABOUT 

f » * ■» ' ' 

group. Only one group, a TH INKABOUT group, specifically used the word criteria., 

~> » * ' 

Host groups .generated responses as they ca^ to mind,^ but rarely did the groups 

complete the brainstorming' process by going back and selecting , the most appropriate 

responses. Three groups, all from THINK ABOUT cla^fees, did use £ form of 

brainstorming. One of these began by ^suggesting brainstorming as one way to hel£ 

■ « / 

plan for the radio station, problem 3, These same groups were observed using 

characteristics of thinking flexibly, but these were isolated cases and difficult 

• t ■* » ^ 

to relate to; just the use of TfTlNK ABOUT. « . , 

« 5 ■ • ' . ' 

Student and. Teacher Discussion ~ 
' : *- * f 

. • Information from th§ teachers regarding how they used .THINKA^UT he*ips to 

better understand what students reported about TH INKABOUT. THINKABOUT was- used in 

< * .i 

a variety of ways by the six teachers whose students were interviewed. The average 

I * , >. . * # 

classroom jninutes spent on activities related to THINKABOUT by the, six teachers are 

.listed ;n Table 18. The teachers varied in their use of previewing activities 

(0-2d minutes), following discussion (0-20 minutes),, alrid related assignment^ (0-60 

• * * > 

minutes). One teacher, class 215', only used THINKABOUT once a week. because 

scheduling made! it impossible to' view the programs broadcast on Monday. 'Even \ 

though students "from these" six cl;asses all had viewed THINKABOUT, there was a large 

diversity among' the classes^in the instructional experience that students received 

regardijftg lx>th time spent and activities perf^ofmed. 



i • 



1 -« 
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* n ^ Table 18 

Time'spent on Activities Related to THINK ABOUT 

by Teachers Whose Students Were Interviewed 

f • 5 — r v * 



Cla3S 
Nliinber 



21 5^ \ 
126 # 

226 * 
136 

235^6 



Pr£ 



10 

20 

.5 - 
# 

10* 

i 

0 



1 



Average Minutes per Week ' * / THINKABOUT * | 

V*g*^9 / Post Discussion Assignments ; Activites Usea 



30 

15* * 
30 

30 , 
30 

%o ; 



20 



15 



0 
15 



15 
40 " 

10 
15 * 

60 



1* Research on rabies ■ 
2. Spot ads over intercom 

1, Developing colonies 

2. Letter writing 

« * . I 

1. Speeches (lang .* krts) 

2. Research projects 
(social studiels) 

1. Made ;a time capsule 



1. * Reporting, 

2. Research 

3. Problem solving 



1. Citfzenship' decision 
making (Addison , 



(Wesley) 



\ 



EMC 



The difference in hbw THINK ABOUT .was used by the six teachers reflects the 
purpon's Ui<'*touehors had lot using TlilNKABOUT. Five ot' the teachers useci 

TH I NK ABOUT as enrichment £9r the traditional curriculum. Three of the teadhers^ 
{215, 126, and 136) used THINKABUUT with a combination ot content areas and twc , 
(115 and* 226) viewed the series more a-s , a subject matter in itself. One teachcjr 
(2-J?5/6) used THINK ABOUT in conjunction with a decision-making curriculum* The 
teachers 1 reasons for using -THINK ABOUT varied fcrom'helpmg students to think — to be 



able % to think* and organize ^226) and to develop independent thinking ana proolein- 
solving techniques (215) — tpp. helping students with content-related skills — for more 



visual enrichment; o£ the cpnoepts of language arts and^ social studies (126)^ ana! to 



develop study skills (136) — to helping students increase their decision-making 
skills (235/6). 

The ratings ol the. six"*teachei. s oh the success of ThlNK/vbUUT and reporting 
positive expediences varied sotae from the ratings of the larger ^roup of teachers 
who completed the questionnaire. The latter group rateu tne sue jess ol ThlNKAbuuX 
hjiqher on strengthening theVabilities oL thinking flexibly lolloweo by effectively 

' / 

* express tn>) .themselves, reasoning systematically, anu then managing the^i own 
lear ung (p.- 76). The six teachers telt THINK ABOUT was more successful in 

^strengthening their stuuents 1 ability to effectively express Cheisiselyes , followed 
by reasoning systematically. Some of the positive experiences of the six teacners 
in u iing Tli 1NKABUUT are; ~" 4 

- The 'eagerness to watch the program anci discussions that refer rea bactf to 
* prpgrams (lib) . t * 

- Observation of an increased awareness of the neea^to think (21b). 

- Kn3oyment of viewing THINK ABOUT (126). 

- students are more organized, *pl an time better, anu are more independent 

(226). , . : 

- ttettet cLass participation (136). 

• - Solving playground problems in the classroom by working together (235/6) .• 

J ' 

Thus, the information col Ujc teu , from the six, teachers indicates t'hat tne' groups oi 
student?, wl^ wt'ic interviewed, had different insti uctional experiences from using - 
THi^KAVoUT, u upending upon their class. Also, the student outcomes (hat were 
observed by the teacher varied -i rom class to class. * * 

The diversity, of the instructional experiences among the classes helps to put 
in jMi j»(Vi iv<; th<* comment!, made T)y th<' student:; after completing, tht tour problems 
besides tilt; time Spent viewing tntT^progra-ms, classes differed gieatl> in activities 
that were related t;o THINK ABOUT. : ■ , 

One cohsi stent comment about* Till NKABOUT made by students -lrom ali cdasses was 
tbat\they liked* the series. C^mmejlts like "neat/ 1 "pretty cool," "1 love it';" 

"pretty good," "i Ui^ke it a lot," and "really good show" were ttequently given 



the students when asked what they thought about THJtttfABOUT, » Students particularly 
Ui^ked the use S§ kids in the series rather than, adults; • "The -kids are about our 
age so (they) probably (do) something like- we would do." The realism c^f the 
situations depicted was greatly appreciated; '" v lt showed you how to deal with * 
problems, not from someone saying ok, you were caught in a storni, this is what you 
would do. Ihey act «ut in front o£ you- problems that you could really do." The 
desir^. for realism was one reason one group of students did not like program 60, 
"Plan A City of the Future." This program was not realistic because "not very man 
kids build a city." Students liked programs where the ending was left for them to 
provide* The three continuous programs (57, 58, and 59) were very popular because 
they were longer and included more information. Students also Wked .THINKABOUT 
because they felt th.ey learned something from the series, "it was educational." 

Students easily and accurately recalled the stories of many of the programs, 
which indicated interest in th,e programs and" some recall of .facts. Filfequently when 
talking about TfilNKABfeuT, students' mentioned the ^ tor y from a program or a phrase 

described th * story. Programs recalled this way include the>airplane crash 
(programs 57T'58, ahd 59), the moose program (program 42, "Maps and Model s"0 , and 
the pond^program (program 27, "Nature's Patterns"). . » 

The ability of students to understand "the intended meaning 6£ the programs and 
to apply ideas from the programs when solving problems was not as' apparent. For • 
example, one group of stents from class 226 was asked what the pond program • 



showed. Their response was, "Not to put a salt block by a pond or a river." When 

0 - 

questioned further, one studen Responded, "I thirjk it was something abbifte*problems, 
They were investigating;^ and kept studying what it v£s all about." The program 
tells tftfout \<gt Susan andjier 'cousin, Howard, discover the reason why^ pond^ life 
cycle was 'disturbed: b^causp rain^Would wash" salt^rom a block of » salt in a jiearby 



pasture into the pona. The program is from the "Binding Patterns" cluster. The 

main teaching points are that changes in nature's patterns may be a clue to a 

* * 

problem, patterns are recognized t}y. making observations ana perrormmg experiments, 

£nd experimentation is* a way of collecting information to answer specific 

questions. Students recalled the story ot the program but did not give any 

indication that they rememberi^d the main teaching points/ ^ 

Students from, dil lerent wrasses reported doing different types of activities' in 

their classes related tp THINKABOUT. What 'students recalled about a particular 

thinking ikill or "how they applied the ideas from the program appeared to be 

related to classroom discussions^and activities, in addition to .viewing the 

progrdms. Students from class 226 reported* doing activities using brainstorming. 

tint- of the tew .groups of students who mentioned or performed a brainstorming 

it/ < 1 

^ptocess wiule solving the interview problems was from this class. On the other 

hand, stu Jents from this class generally „ reported the superficial meaning of the 

X ' i 

stor/ Iron some programs, such as the pond program. ; The teacher of thas class 

* * * * * > 

reported spending no time discussifig programs (Table 18) . 

Stuuents from class lib regularly participated in discussions JoiloVmg the 
/ • • 

programs as reported by the teacher (Table 18) and th;e students. Students from 

this clas:< saw a relation hetwe^n the lour interview problems ana the ThlNKABOUT 

programs that (Jiscuss planning. They .reported that they used information from the 

programs in working on hobbies, doing social studies, ana solving aaily problems. 

Students froin^ class 136-^ which also spent time disc&ssiny' programs, reported 

talking about criteria, what you can do if ydu do not have' enough information, ana 

how you can find out more from a boc?'k than you thought was there. One student from 

"this class commented . tnat sometimes the whole math class, 45 minutes, would be 

spent balking about. a program. In class 126, there was little discussion of 



% - programs, but students reported that they used brainstorming and criteria in class * 
activities and that" these helped. What students^ recalled and reported appears 
be related to class dicussions and related activities** Students were able to 
recall very well the stories of the programs. When the ideas were supported by ^ 
related activities, the students appeared to get more meaning a*hd were better able 
to apply the ideas. 

Students did report applying ideas from the programs in school and in their 
everyday lives. Students frQm class 115 divided the work among 'students assigned 
to work together on a social studies project. Students from classes 126, 226 , and 
235/6*used brainstorming* One class, 126, brainstormed to help generate rules, for 
their class. Students frtfm several Of the 'classes used criteria but had different 
conceptions of. what critera are. .Students from class 115 interpreted using ^criteria 
1 as outlining. Students from class 126 thought tjiat getting information was using j 
criteria. Students from class 136 gaye .as an example of talking about criteria 

r f 

when you talk about hdW you csn find the answer. Students from 235/6 resolved 

•fights by using critera.- Students /rom class J26 reported 'organizing material or a 

store, making time capsules, and considering punctuation in writing reports. The 

?- <+' v ■ 

program about patterns was used by students from class* 235/6 In studying the 

murders of ch/ldren in Atlantal «• * 

Only some of the gr6ups of students reported using ideas from THINKABOUT inj # 

solving everyday problems. Students from class 1J.5 gave as' examples decorating a 

I .room, resolving a conflict between practice for soccer and baseball both scheduled 

' - *b 

at the same time, and coordinating with family members in order to be transported 

* \ 
to go skating. Students from class 136 reported .relating back ^program's and 

using the way problems were solved in the programs^to solvs everyday problems, "You 

can jump back to what they did." Other students use ideas from THINKABOUT in 

' o W GO 
ERIC kJ/ , • 

' H "" B ™ • « 



sorting ideas, to think about the best "ttomg to do, and to meet deadlines.^ One 
student only used THINKABOUT on occasion, "I only do' it when I get into trouble. " 

Only a\few groups of students found any relationship betweeq THINKABOUT 
programs and solving the four interview problems. Students from class 215 made 
general comments that they thought ^they could have done as well if they had not ^' 
watched THINKABOUT. The need for planning, discussed in ThINKAbOUT, was seen b> * 
students from class 115 to be needed in solving the problems. Students 'from class 
126 ^hao not seen problems like the four problems oetore, but thought tnat 
brainstorming, ujsing criteria, setting up diagrams, and organizing information 
holpeu in solving the problems. Other than these examples, groups coulc not make 
direct connections between THINKABOUT and solving tfie* interview problems, o 

The students from the two classes which had not usea THINKABOUT ftaa haa some 

experience with projects and solving problems, but not to the same extent as the 

** * * 

* 

THINKABOUT classes. The non-THINK ABOUT students were more limited in experiences 
related to problem solving. Students from, class 315 had worked on projects and 
reports using encyclopedias. When they were interviewed, th'ey were doing a project 
on the human body requiring making diagrams of the human skeleton. The main 
suuL'ceb ot information that groups of students from this class consistently gave 
wh^en asked,what they^, would do when confronted with a problem they could not solve 
were tne teacher, "a gcown up, /and an encyclopedia. "I kick rayself" was one >t 
student's response to what he would do to help think of an answer. Students, from 
class 320, the sixth grade non-TlilNKABOUT class, hau done some proolem soivjju, with 
the counselor. A group met with the counselor and students put problems into a 
box. Problems then were <^rawn from the box and solved by the group, ^tuuents from 
this class said that they ha^uever ;;ocn problems like the ones they were given in 
the interview. Math and sfcieneeVwere areas that were given as scnool things that 
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would help in solving" the problems. A dealer or library were, given as sources of' 
information. One student from each grou'p knew something about brainstorming. .Ndne 
of the groups knew what cri'teria or 'blockbusting meant. Alternatives for o&e group' 
were different people , different ways, or different solutions. From the discussion 

V f • 

with the students from THINKABOUT classes and non-THiNKABOUT classes, students had 
had different experiences and the differences became apparent a*s t\\e students* 
talked about what they would use tow solve problems. 
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* ' COLLUSIONS AND LIMITATIONS 

» * * ♦ 

This study is mare hypothesis. generating than hypothesis testing, more 
ethnographic than experimental, and more information collecting than issue 

resolving. flie main purpose of tfce ?tudy is to provide information that can be 

• V? \ 
us*ed to make decisions about instructional -support for THINKABOUT in Wisconsin and 

\ 'V : • % 

for futijre ^instructional television series/controlling factors 6n the scope of. 

» 

the study were time, money, available personnel, and willingness of teachers and , 
* ' . * v * 

students to part ici£*ate. Most of the data collection and 'analysis was done -by one ' 

person with an occasional check of" reliability from another person. The study does- 

* # * mm < - \ 

provfde information on how some Wiscpnsin teachers are using THINKABOUT and on how 

* . \ . * 

* THINKABOUT has, ; ; af f ected some students. " The validity of tfie conclusions of the 



0 



study are based on a detective model where.jnore credence is given to$ information 
that is substantiated by a variety of sources' and by its reasonableness. 

^ The sources of ^information for this study.were questionnaires completed by.,58 
teachers who were^using THINKABOUT during the ^1980>81 school year, questionnaires 
completed by seven teachers who had used Oj^INKABOUT the previous year but were not 
using the series during the 1980-8^1 school year, responses and protocols of 24 * 
gfoups of students solving fou# pi?oblems, "discussions by these groups of students, 
arid questionnaires 6f 29 students who had v^wed THINKABOUT during the 1980-81 
school year. The 24 groups of four student^j^ch came fronPeight classes, three 
groups from each class. Two of the classes .had not viewed THINKABOUT. All of the 



data was ^collected during. April and May 1981. 

' \ 

Descriptive statistics were, computed for the questionnaire items. Nine/bf the 
teachers who completed questionnaires were 6 4^J> e ^ vi ewed by tel^ghjfoe to validate * 
information from the questionnaire and to provide more detail. 'Each group of 
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• < • 

students who worked on the four problems was given a score or scores on each of the 

problems. Class scores on each -problem were computed by taking the average scores 

of the three groups from t^ ^.ass for problems. Land 2, and the sum of ^scores* for 

"each group on 



problems 3 and 4, Verbatim- transcripts we^iie made of the student 



interaction while students solved the four problems.^ TKese^ protocols were anaiyzed 
by identifying specif ic examples and evidence of the four general characteristics 
of independent * learners emphasized in THINKABOUT — expressing themselves* 
effectively/ managing their own learning, reasoning systematically, and thinking 

^ L 

flexibly. Processes used by all of the three groups from the same;class were 
identified as a characteristic 1 o^ the class. c o 

The estimate of the percentage of Wisconsin grade S and gracje 6 teachers using 
THINKABOimduring the 1980-81 school yea# is 26%. Most teachers* used THINKABOOT 
because the series emphasizes reasoning, thinking, problem solving, and decision 
making. Ttie decision to use THINKABOUT was most frequently m^de by the teacher. 
Two-thirds of the teachers used two programs a week. On the average, 18 minutes a 
week were spent on activities re,lated to, THINKABOUT in addition to time spent 
viewing the programs — six minutes in previewing activities and 12 minutes in 
discussions following the programs. Two-thirds of the teachers did some form of 
previewing activities, and 88% engaged in some follow-up discussions. * TVo-thirds * 
of the teachers did not xJo any other in-class assignments related to THINKABOUT. 
The ones that did do assignments mainly did activities from the teacher guide, used 
by 70.% of the teachers. Very few pf the teachers mentioned any materials that they 

• . . . • V 

had prepared to use along with THINKABOUT. 
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What are the effects ot" THINKABOUT on teachers, ~ students, anu instructional 
- prog rams? £ ' 



« : ... / 



Teacners anu, students who hacr^iewed'ThlhKABOUT we\re very positive cowaiu tne • 
series. Nearly all of^ the teachers (97%^}ano most ot the students (75%) gave tne 
series a positive rating, 'lhe groups ol students who were mtervieweu and wno nao. 
u: »ed- Til INKAIWUT ..i i 1 had positive experiences with the semes. Their appreciation 
oL the sen-es came out in their eagerness to -discuss programs anu to relay 
experiences they had had that were related to THINKABOUT programs, leachers and 
■ LiMHiii liked some programs better tfhan others, but Luvorite program., were spread 
over the 60 possible, indicating the diversity ot the programs in the series. 

• Reasons given lor tne appreciation ol the series by teachers were the nigh interest 

" ' / 

level of their students in the series and the student learning^ tnat tooK place f$om 

' the prog r nos. * i 

ihe evidence is mixed on the ellects ol THINKABOUT to strengtnen' the lour # 

•s 

qiu» 1 1 1 ies ol independent learners and problem solvers that the series was designeu 

* to ot?velop in young learners. Tneie is some evidence that the use ol THJLfthabOUT is 
related to students more efiectively expressing themselves. In solving the 

-problems, the ThlNKABoUT students were- much more> comtor table in expressing lueuSAlu 

■ 1 \ • / 

the group and engaging in dialogue with other students than were the stuaents/wno 

huu not used Th INK ABOUT. Bueth groups, th£? six teachers bl the students wno were 

„ i ntcj viewed and the 58 teachers who completed the questionnaire/ gave a *high mean 
0 J 
fating ^<> Lh<- success of THINKABOUT in s t r e ng then i ng the stuueiits* 1 ability to 

effectively express J^hemselves compared with ratings of "the other three abilities. 

This impression ot the teachers and the results of the interviews, along with tne 

r 

results of the AIT impact study regarding certain communications skills, provide 
evidence that using THINKABOUT does relate to stuuents being better aole to 
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eftective/Ly express 4themse Ives. One*caution in interpreting these- results as 
causal is that teachers who are more interested in having their students -express 
themselves wfoy choose to use TklNKAbOUT because the series supplements what they 
Unci is important. This is different Lrom THINK ABOUT being a prime cause of more 
effective communication* Information from this study does not differentiate 
between the. two cases. The data does 'indicate that 8b% of the •teachers completing 
thi-'quostionnaire had* students participate in discussions following the viewing of 
pioMt.iiir.. N<> int urnuit ion wai veoi Looted regarding the ex-tent that students from the 



non 



-THINK ABOUT classes- par ticipateci in cl,ass discussions/ Evern though it is 



impossible to bay that THINKApOUT is a cause ot student shoeing ,able to more 
el t <'Ct ivcly express themselv*^^ there appears to be a relationship between the u£e 



of tlie» series and the ability* ^ . ' 

<* 

* TH1NKABOUT students exhibited some attributes that would help in managing tneir 
own ^earning that were not exhibited by most of the non-THJNKABOUT stutfeots. In- 
solving the four problems, THlNKAbOUT students would bulla upon *i0eas given by 
othri mrmbrrr, ol the qroup, claniy an idea given by another member, and evaluate- 
ideas un occasion/ Nun-TH INK ABOUT students were rarely observed doing any oi thfcse 

Vr • , 

actions. One outcome of clarifying ideas, building upon ideas, and evaluating is ^ 
that the THlNKAbOUT students responded to problem 4 with more strategic response's,, 
responses related to planning, then did the non-THINKABOUT students, , As a J result, # 

* i 

THINKABOUT students appeared more systematic and reflective", particularly when 
.solving a structured and realistic situation sucn as planning a science project. 



Another indication of THINKABOUT students possibly being .able to manage their own 

# 

learning^ better is their willingness to work harder on^a project wheji confronted 
with time constraints rather than just reducing fche-scope of the p'rbje&t. how 
-students apply what'was observed in the, interview, Situation to taking charge of 



L- 



their* own learnmg in, school is questionable,, since teachers £at-»d THINKABOUT tne 
least successful in strengthening their students 1 ability # to manage their owrr 
learning than in strengthening any ot the other three abilities, THI^Krt&OUT , ( 

students did exhibit beneficial characteristics related to managing their own 
learning in tho lectricLed situation ot solving the interview problems Uiat were 
.no*t exhibited by the non-TH I NKABOUT students. -> - j 

,1)1 11 < i *:n<ji i. wa'U' not fc4>:,< I vrd IjcLwueiS'J'lllNKABOUT student, umi non-Til 1 nKaBOUT 

c 

♦ ■ " 

students in their ability to reason systematically?- All groups had difficulty in 
making inferences and drawing conclusions. in other aspects.of reasoning , < 
systematically, such as using a criteria or noting conditions of the 'problem, 
u 1 1 l<_ rone :s were noted among groups, but the differences wert: due to the particular 
group ca trier than to the 'use of THINKABOUT. Nearly half of "the teachers wno 
i6spunutd to the questionnaire reported some success of THINKABOUT in strengthening' 
ttreir stuuents 1 ability to reason systematically. Whatever benefits, to u^sing 

\ " . . • . \ 

THINKAbOUT thnt teachers obsctved regarding reasonmg„systemalicaliy , tne benefits 
wen: riot observed in the interviews. 

bviaence tjpm the stuay indicates that THINKABOUT was related to more ttasiy/bie 
'thinking by students. V The THINKABOUT students at both grades 5 and 6 lis£ed**i 
greater variety of information sources than did the non-TH 1 NKABOUT students ori one 
part of problem 4. Other differences were more noticeable at the fifth gr,ade level 

4 

Trie fifth grade THINKABOUT students had mofcfe breadth In their responses, a^vajriety 

j • ' ' * 

or difterent responses, whereas the non-THINKABQUT st.udents had mo$e depth in their 



response: , a number ot related responses. On a few isolated instances, groups wno 
had viewed TH INKABQUj^jj id some form of brainstorming and did mention noting 
criteria, tyone ot the non- Till NKABOUT stuuents used any '.ot these techniques. Many, 
teachers felt THINKABOUT affected flexible thinking in their students, with nearly 



^50% of 'the teacher^ rating the success of the se^ie^^positively in strengthening, 



this ability in their students. \ ^' > ~*\ 

Even 'though THINK ABOUT students did not all use techniques from the series to 
» 7 . •• ■ ' " * ' " . , 

help in their- thinking , the students were at least aware of the techniques, could 

describe them, and could refer to them by name. Only a very few of; the. 

non-THINKABOUT students knew about brainstorming and had difficulty in explaining 

the .technique. 'None of the*non-THINKABOUT' students knew, the meaning of criteria or 

bloqkbusting. Another factor related to students thinking more flexibly was the 

«V 

use in. the classroom of Skills related to flexible^ thinking . Those. 'THINKABOUT * 

students who, used brainstorming while solving the interview problems were the ones 

who reported doing brainstorming in class in addition to viewing THINKABOUT. The 

results suggest that THINKABOUT provides the potential to help students think more 

flexibly, -which is realized through classroom and otfier support activities. 

* * 

The relation of THINKABOUT to strengthening students' ability to be better 
problem solvers and independent learners' is corroborated by two sources/ Nearl) 
half of the teachers who* responded to the questio^aire. fe^lt that TH I NK ABOJJ^ha d 
some success in strengthening theflfe abilities. The series was felt-tt) be * * 
successful in strengthening problem solving by more teachers than in strengthening 
independent learning, 52% cqmpared to 43%. Most t>f the other teachers were .neutral 
toward, THINKABOUT \s success in these areas. Another indication of teachers 1 
impression that THINKABOUT has Some benefit In problem solving and independent 
learning is* that these outcome^ were include^ frequently in the reason why- the / 
series was being used. A ^second source providing evidence of THINKABOUT success in 
effecting these abilities in students is the observation of facets of thre£ of 'the 
four qualdties«r-ef fective expression, management of own learning / and flexibile 
thinking— *df these abilities as students solved problems. As nQted ^JHIN^ABOUT 



<stuaents were observed using some facets o£ thes'e ' qualities more frequently than . 

were non-THINKABOUT students. Since the report of teachers Regarding the success 

£ ' \ 

of THINKABOUT in strengthening these two very, ^complex abilities in stugents wa$ 
positive but not overwhelming, and sinSe THINK ABOUT students did not outshine 
non-TH I NKlloUT students in all areas, THINKABO0T alone does not constitute, nor is 
it designed to be, a complete curriculum on. problem solving and independent 
learning. THINKABOUT ,does appear to supplement the growth of these two abilities"- 
in students. ^ * . 

^ ■ What students recalled from the programs and their application of tne ideas 

t i *' ' f : 

from the programs corresponded to the amount of class discussion and related ; 

* • ' , 
activities that occurred. THINKABOUT students who mentioned, brainstorming or usejfr 

• * 

the technique* while solving the interview probJLems,were those who reported using 
the technique in .some class activites. O^hej THINKABOUT students knew what 
brainstorming was but were not observed using it. Most non-THINKABOUT students old 
not know what brainstorming was. Students from classes who 'regularly participated m 
in di scissions of the programs w.ere better able to relate- programs to solving, the 
interview problems and were better able to oisduss the meaning from the programs 
rather than just^the storp Thus, THINKABOUT students ^appeared to g-et more meaning 
and were better able^to apply the ideas from programs when the ideas were 
re-inforced by discussions and related classroom activities. 

There wdb 'some evidence that THINKABOUT provided an enriched experiencial oase^ 
for the THltlKABOUT students that the non-THINKABOUT students^did npt have. This 

' \ y ' 

enriched experience included program stories; a different voc^Dulary including 
words such as brianstorming , criteria/ and resources^ to name a few; ana the 
application of thinking, skills. This experience provides a basis from which more 
involved work in developing thinking skills can take place. * § , 



'1 
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What instructional support do teachers need to implement THINKABOUT mote 
effectively?" 



Even though mo[st teachers had nqt receiyed any in-service on using THINKABOUT i x \ 

\ " " ' ' 

only a. third of the. .teachers expressed any interest in having an in-service of in 1 

*mee*ting with othjer tethers who ar$ using THINKAB'OUT.' . Not having enough classrooiji, 

time for activities is a major factor of not being interested. 



Most of tfie teachers did not feel that tke* suggest'eS materials on the 



questionnaire would be very useful. foe materials, listed in 'their rated order of 
usefulness, were duplicating masters, teaching posters., and learning games* 'Again, 
•'time pressures f o elt by teachers would result in- such materials not being useQ* 



/ 



Some teachers 'mentioned the need for tnor&*suggestions of activities or 
follow-through materials <for k each program. * — * 

Even though few teachers expressed interest in attending an itv-service, there* 



is one indication that teachers can benefit from an in-s*ervic£ proVidihg it 
addresses some of the real pr ofclemsr that* teachers. face. Teachers, on the average, 
do not spend a, large amount of time on TfilNKASOUT and related activities. Th'emeap 
amount iof classroom time, spent a Week related to THINKABOUT. was 48 minutes. Since 



\ 



ERIC 



two programs are shown in' a week, this breaks down for each program to 3 minutes' 90 
•for previewing activities, 15 miniates for the program, and 6 minutes for discussion 

following the pf ogram. Only one-thlrtf' of* the teachers did any other type of • 

"1 "'• V ' - m • " < ' J* 

activities. Some teachers .exprese.d frustration in n£t having enough time to do ' 

follqw-up activities* Orfe reason that some teachers did not do^many activities. 

* * » ' ' 

from the teacher guide was because .they were too time consdniing. On the other' 

• v . [ ' " - '. ■ ; / >. ■ ■ 

hand, some* teachers have integrated THINKABOUT, activities in their regular* 
curriculum and have found these activities to b<e supportive of .theiic^goals. Thus, 
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4, jl' : # V . . " . 

a major problem felt by some teacher s, time constraint, was not a concern to other 
teachers* „ - 

An in-service on .THINKABOUT which deals with finding time to .do THINKABOUT ~* 
ac,tivitie£ may be of value, m Such 'an, in-service can have two emphases. One is to 
help teachers fit THINKABOUT activities* into their 7 basic cu-rr iculum— language arts, 
social studies, and mathematics/^iyLs emphasis would help teachers see that the 

activities are a part of ,the content areas rather than an addition -to these areas/ 

> 

A second emphasis is to have teachers who bave successfully found time for 

\ *• \ 

THINKABOUT activities to explain the kind of things they do and how \THINKABOUT 
ideas are reinforced throughout their instructional prpgram. « 



What can be done to expand the use of THINKABOUT in Wisconsin? 

No pprtioylar characteristics describe a'te^cher who is a potential user of 
THINKABOUT with the exception that the teacher has used other ITV series. Basedion 
the teachers in Wisconsin who ar£ using THINKABOUT, the Series appeals to a diverse ' 
grqjup. ' THINKABOUT teachers vafy greatly in their years ' of teaching experience, r/ ) 
teach both .in self-contained and tezm te^cliing 'situations, and vairy in their 
content area speciaf ties.,. The one common experience of THINKABOUT teachers is that «r 



nearly *all\(88%J havevused o£h^LJTV series. 



Teachers who are potential "user s of THINK ABQUT cart be partitioned into' two 
groups^ ea<*h-with its? own concern. One grbdp, is the fifth and sixth gsadp teachers 
who are not using THJNKABotiT at sfchools where other teachers are 'using THINKABOUT. " 
-j , A concern of this ^roup is showing programs from the series to the san*e <group of * 
students twice* both at fifth gradfe and sixth grade. DifSerent schools have 

. N. * " * ' 

handled this, situation by showing the series to both jEifth and sixth graders eveny • 

other year, or. by dividing the programs into^two ao^s— those to be shown to fifth 

*■ ' - *i ■ • * * * i r 
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graders and those tp b% shown to sigcth graders. One student in the interview who 
had viewed THINK ABOUT tfce .year before at another , school* enjoyed seeingfsome of the 
programs a second time. He was better able to understand what was in the program 
the second time. This responds to some teachers' hesitations of showing the 
program to students a second year 7 , * j t 

. The second group of teachers who are potential. users rare those at schools where 
TH^NK ABOUT is not being used, These teachets are probably less familiar -with 
THInIkABOUT and need more information about what THItfftABOUT is and its potential 
effects. - The enthusiasm that many teachers expressed in this study may be an 
enticement for. these teachers. | * 

. » The most effective channels for information is direct information to the 
teacher— - In three out of four cases, the teacher was .thei one most influential in 
* deciding to ^se THPNK^BOUT. The materials frpm which most teachers initially heard 
i about 'SFHINKA^OUT wer.e those 'that went directly to or^were used by teachers, the . 

. Parade of Programs * and mailed brochures. These both are means 'of providing c 

* ■ ' - ' ' V 

information to teacher s r who are* potential users of THINK ABOUT. 4 . 

: • < \ m ' '-. • I 

What Implications -are there from the implementation of THINKABQUT over two yearns " 
f or , the support and" production of future fnstr uctiona ; l^television series? ¥ 

9 THINKABdUT ^nd. its effects have implications tc? othet ITV series for 'this age 
T^vel^particularly in id^ntlfy^ of fifr* fip r 1?? *-\*?tt oppar^-f^thr ^""^ 

students. 'Students wfere very positive toward viewing kids their own age solving 
reaJL li5^-like problems. The programs were, .relevant *and dealjt with situations that 
fifth aftd- si3fth^graders could idieriltify with » Students iiked having open-endecj 
programs wher»4 answers were lef t £6sT them to contribute. The tjjVree-program serial 
was welJU received because the. story was extended over a * longer* period of timp and 
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was more developed. This is- a contrast to most ITV series where each 15-minute 
program is designed. to be self-contained. • -v 
^ . - .The results of this study point to the importance of classroom activities in 

having students apply the ideas presented in the programs. The programs provide an 
enriched experience for THfNKABOUT students' to draw from. However , the ideas 
Planted by the programs need to be cultivated by additional activities to be fully 
# -realized.- There was some indication of the need to include in the teacher guide' 
' well specified and ready-to-use activities. Although the guide was highly thought 

of, some' teachers suggested -'including less time-consuming activities. Such 
•activities would respond to the time restraint* that teachers feel and to' the need 
for doing activities to obtain thp greatest benefits- from the programs.' 
_ The story lines of the programs -helped students .to recall what happened in" the ' 

programs and the skills that were presented,; Students could recall many of '.the 
programs and describe the story in- somedetai^ ^The recollection of the story, ' 
V however, did not mean that the, students would apply the skill presented or Wd ' ' 
generalize beyond the situation depicted. Follow-up activities and cUssroom- ■ 
y m applications or the s^iils Vided students in appl^ng the skills. ' « 

r • ~ . • t ■ ' 

^ • ■ « ■» 

Limi tatio fis ' " . 

'• '* * 

. The number' of teachers (65) and the numberof students who participated in this 
study are small.^ The participants were volunteers that. constituted a sample of - 
. • convenience, rather than a random sample. Because of this a*! is a question about 

. -• ^ *»•"««•«>*"* of .the^resuits of the study to a larger population, other fch>n" . 
r to those who par.ticipated.in W e study ^ The teachers and stucLts did cbme from . 

' ^scbod'is located in different s^sbf connnunities and . from si.x d 

Wisconsin. The mearts of standardised achievement scores of the classes.©* students 
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who were interviewed , were slightly above grade level.' The. stuaents and teachers 

who participated in the* study came from schools which were characteristic of many 

schools in Wisconsin. However, because the numbers werk small, the teachers and 

students included in the study cannot be assumed to be a representative sample of 

those'in Wisconsin, which limits the generalizability of the stuay. 

There* is sane difficulty in sorting out effects due to THINKABOUT from other 

classroom 9Xpenences. Students were' only tested once. The two non-THINKABUUT 

classes were selected to match some characteristics of the THINKABOUT classes but 
I 

some differences among t the classes were not controlled, such as teaching style, 
content covered, and previous instructional experiences. Attempts were made in the 
study to substantiate information from dilferent sources in order to form , 
relationships with THINKABOUT. The control classes alloWed°contrasts to be made 
and helped to highlight differences that appear to be related to THINKABOUT. 
However, for results to be unequivocally attributed'to THINKABOUT much stronger 
controls need to be jrsed. • , ' , ' 

The procedure ot the study was designed to generate information and. not to ^est 
hypotheses'. As a result, not all groups of students were as,ked the same questions. 
Instead, questions were asked to clarify the students 1 responses and to better 
understand their instructional experiences. A scoring scheme was adopted.. to provide 
sco^^tor problems 1 and 2. 'The scheme was' designed to take into consideration 
the understanding of the problem, means used to solve the problem, and the answer. 
Other scoring schemes may have resiilteu in other differences^ among g^otift# 6 on their 
scores Lor .thpsc problems. . Scoring on these* problems was*dohe by one person 
without a reliability check. Th£ scheme to score 'problem 4 haa been used in other 
studies, making the results on this problem more applicable for comparison to those 
of other .studies. Information was collected for groups and classes' ana not foe 
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individual students* There may be particular effects of THINKABOUT on individual 
students, but this study was not designed to identify these. The procedures do 
provide information about^groups of students and how classes of students responded 



to THINKABOUT* 



t 
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Appendix A 



Teacher Oaestibnnaires 



Included in this appendix are two questionnaires and the fqrm used in ^ 

1 ' »' ' * * • 

interviewing teachers' over the telephone. The first guest ionna-ire was sent to the 

: * ■ ■ . • • ' » ' . 

teachers who were using THINK ABOUT.., The second was sent to. the teachers who had 
used ,THi[NKABOUT the. school year 1979-80 'but were not using it the* school year * * 
. # 1980-81. Th*e means ancf percentages of th£ responses are included on the 

q^sfcionnaires.** A total ot 58 teachers responded to* the questionnaire who ,we*e* 
usinc| 'THI1JKAB0UT ( and sever} who^were not currently using THINtfABOUT but who had us^d 

it the previous year. ; . 9 • #t - " 

N * * . • " / 

* * T * * • J . 
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ThinkAbout Teacher Surv^ 
Wiscortsin Educational Television. Network 
• 9 J May 1981 * 




• > 

c « 
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DIRECtTonSi ■ Pleas* circle the appropriate, number for each item or fill in your responses. 

* «- * * ' • H - » 

Section A: BACKGROUKD INFORMATION « 



Code No. 
Grade 



l! How many years of full-time teaching experience 
do you have? '* * 

2. Which best describes/the setting ^ which you teach?? 



years 



Self-contained classroom 



3. is there a content area that you^ consider your speciality? 



4 



6. 



4 



u/^ ^> 2 e Units or team teaching' 

"-*7<J*3»* Departmental by'-subject (specify) ^ 

3% ** 0tner ^please specify) * 

%C%\. No t 

£0$2.~ Yes (specify)^ * 



4. Howjmany ^teacftefs teach grade *5 and/or 6 in your school? 

5. How niany *bf these teachers are us-ing^ ink About? * • 



Are any otheV teachers in your school using ThinkAbout? 



4 



« Teachers 
Teachers 



1. 
2. 



NO 

Yes (explain) 



. i 



7. rfow is. ThinkAbout "being used? 



As a Subject-matter in itself « 
Only*j»s part of language arts r 1 
Only as^ part of social science 
Only as" itatt of mathematics 
pith a combination of content areas 
Other (specify) , * . 



9. How is ThinkAbout used in re^atforj to traditional currioulum 
. material (e^. ^textbook) ? y ^. 4 



V 



'As an alternative, or replacement ^ 
As'VTupplement or addition %; 
As enrichment - % / 
Other (specify) ^ _^ 



9. What Jls the teta^nuraber of your students using ThinkAbout?, i(r^>' /0 



Students § flfj.Vt 



10, What .groups' of % you t students are using ThinkAbout? 



i.'; aii" V ^ 

2* Special groups only (specify) 



11. Who was inost influential in the decision* to use ThinkAbout? 



r 



12.^ Where or^ from wtoom did you fir.st hear about ThinkAbout? 



I 



13. Wtiat in-*service have you received on using ThinkAbout? 
* r * 



14. 1u ThtrtkAbou^ the first ITV series you have usedj 



V 



O 1. £t*te o , , SV„ 2 » Central administration 

3+ fcuflding principally 4. . M^dia specialist 

t?*2* 5 * You I9?fi* Other teachers 

7. ( ITV representative^ 8. Combination of above, or 
. c~r *> other (specify) . * 

^•"4* 1. Professional meeting* * 

7'^ * 2 \ ITV representative * *" * 

VO % 3. Parage ^f Programs . 
4. * Workshop 

Other teachers ~ > 

6. Building principal 

7. ' Hailed brochure * ' \ " 
8. 1 OtWer (^pecify)^ * 



11% 5 

2>o% 
1% 



3. 



None * , t> 

School workshop (presented by * 



r . 5. 
1 1 % i- 



district workshop (presented by 
Reg^orral^ workshop (presented by 
Other (specify) ' • 

< ~ " 

Uo (sptfcSsify others you have used) 



P 



SECTION B: USE OF ThlnkAbout t 7 
15. What is. the main* teason you are using ThinkAbout?*- 
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16. How do you view ThinkAbout? 



Live basis 
Tape delayed basis 
3. Other^* (specify) 



► **17. When*<Jid 'y°ii begin us ing~ThJnk About? 

• • M * ' 

18 b How many minutes do you average eie> week on these activities 
♦^related to ThlnkAbout? . »*■ 

* Previewing discussion or activities t ^ : 

, * v Viewi'n^ *he programs £ t «j 

,# Discuss fons immediately f^lpving programs 



1. 



\ 



Other in-class assignments directly related to Thl 
» **Total minutes spent on ThinkAbout ^rer week 



nkAboftt 



2 OS 



spent 

(Sum of the four times above) 



$0? 



4. 



4^4. 



5. 



19. Of .the 60* programs, how many different ThinkAbout programs have 
your class viewed this school year? ' «* 1)*0i 

20. If ypu used less than 6(h programs, what criteria did you use to 
select the programs that you viewed? . * 

* ' * < * J ■ 

% 21. Wha-t are the program numbers of the best three programs in the*$ 
ThinkAbout series? \ 



22; What are* the program .numbers of the wo*rst three programs in the 
}' ThinkAbout series? * 

f . ' 

23. What are activities or projects that your class (es) has (have) 
done that are related to ThinkAbout? ^ m 



1. 
2. 
3. 



1. 
2. 
3. 



Month 



Year j<% ]%// 6 ' a 



Minutes 
Minuses 
Minutes 
Minutes 



o Minutes 



\ 



^Programs 



program 
program 
program 



program 
• program 
program. 



SECTION C: SUPPORT OF TH I MX ABOUT 



24. How would you rate the Teacher's Guide? 



25. What; in the Teacher's GuY^e should be, changed to make it 
. more 'useful? 1 < ^ 



26. Please indicate how important- it would be to have each of the 
^ following materials to supplement tUe Teacher's Guides 

* Set of workbooks I 
v Set of duplicating masters 
Set of learning games 
Set of teaching posters _ ' 

Other (please specify) , ' '' 

• t t \\ 1 , , 1 ; ; 1 



27 .^Please indicate your preference for the context in which these 
► materials (workbooks, duplicating masters/ learning games, 

teachfng posters, etc,) should present ThinkAbout* stories and 
activities: (please circle all that apply) « * 



28. What could be done to help you implement ThlnkAbout more 
effectively? , » 









\ 


Do not 
have one 


Very Poor 




Excellent 


> o 


1 


2 . 


3 V " ' 5 . ; 




• 

0 . 


a 


<>% 2? Z u % 

\ 





Not Necessary Useful Very Useful 



Xt>% 



1. 



ti% 2 
2 

2 

3'?, 2 



/0%3 
3 
3 

?-)<9. 3 
2^,3 



Essential 



4 

* tfejr 4 
)% 4 

q<?. 4 
i% 4 



' • 2/^ ^^ 

Context of 2, Subject related 3. Other 
everyday content 

situations a. Language "arts 

M% b. Science ^ 

fiO, c» Social studies 

\% d. OtheY subjects 



(please, 
specify) 



{please speoify) 



9 

ERIC 



so 
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29. What supplementary materials have you prepared to use, with * 
TjilnkAbout? 

30. Would you be willing' to share these materials with other teachers 
j * using ThinkAbout? . * ' , «. 

V 31. would you like to meet with other ^teachers from youc area who 
are using' ThinkAbout? 

« 32. If so, when are some good times for you to meet during the 
school year? . * * 

33. Would you like to have an in-service on ThinkAbout? 

SECTION D: IMPACT OF ThiftkAbout 
* * 

"34.^What is youteoverall rating ot^ ThinkAbout? 



3S. The reaction of my students to ThinkAbout is highly favorable. 



36. I bring up ideas from ThinkAbout programs when teaching other 
subjects. • ' * 

37. My students bring up ideas from ThinkAbout programs when *^ 
studying other subjects. 

v - 

'33. ThinkAbout programs arouse discussion in my class(es). 

39. Most of my students participate 3 JJn discussions of ThinkAbout 
programs. *\ % 







« 
























4 

\ 




• 


* 














l. 


Yes 

m. 


*2. 


No 






l. 


Yes 


2. 


No 












• 






l. 


Yes 


2. 


No 


40ft 




Very Poor** 


Poor ? Mixed Feelings 


* Good 


Excellent 


V • 1 2. 
Strongly. Disagree 


3 


4 5 
Strongly Agree 




1 


2 


3 


4 


5 
















1 


2 


3 


4 


5 




1%' 










3.3J 
1 ■ '/J 


1 
1 


2 4 

z 


3 
3 


4 
4 


5 
















i 


2 




4 


t 

s 

5 




2'>:. 




2/9, 







te interested in^youWterception of the degree to which ThinKftbout was helpful in improving the skills of your student». For 
item listed tfelov, prease rate by circling a number from 0 to 5 (0 to indicate not at all helpful, and 5 to indicate 



we ace 
each 

extremely helpful) >, the" degree 1 to which ThinkAbout was' helpful to your students in improving their skills in... 



40. finding alternatives. 

41. estimating and approximating. 

42. giving and getting meaning. 

4 3. collecting information. ' 
4 4 4. classify inq. 
45. finding paterns. 
*46. generalizing. 

47. sequencing and scheduling. 

48. using criteria. 

. * t 

40. reshaping information. 

4 

SO. 3udging information. 



51. c^ntxunica ting "effectively. 

52. solving problems. 



7* 
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Not at 


all helpful 




Extremely heloful 






0 * 


1 




. 4 


5 






0 


1 


? 3 


4 


- 5 .. - V 




i.'V 


0 


1 < 


2 ' 3, 


4 


5 




. * 'I- HO 


0 


1 


2 3 


4 


5 




\ ; - 


0 


1 


V; ■; 


4 


6 

« 






0 


X 




4 


5 ' 


* 


3- 'I 


0 


1 


2 3 


4 








0 


1 


2 3 


4 


5 






0 * 


1 


2 3 


4 


5 




3 IL 


0 


1 


2 . 3 


4 








0 


y 


2 5 \ 

2 3 


4 


5 






0 


i 


4 

i 


5 






0 


i 


2 3 


4 


5 




— . •» 

V 








* 




* 


. -• \ / 


* ** 
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• . • - . \ • . - r ' • ; • 

How would you 'rate the success of ThinkAbout in strengthening • \ 

your students* ability to... ^ ( VerV low level ' yery hjgh level- 

« of success » of* success * 



S3, be problem solvers. 




1 


. 2 . 


3 


.4 


m ^ 5 




54. be % independent learners. 




1 


) 

• 2 


3 


• 

eVi 


- 5 




55. effectively express themselves. * , 


' -3- >0 


1 


2 


3 

* 


4 


5 




56. manage their own learning. . 


3 *v 


1 


2 


3 


4 


r 5 




57* reason systematically. ° 

58. think flexloXy. \ 
a 




1 


2 


3 


4— 


5 




- \ XS? . 


1 


2 * 


3 


r 


S 




59. please identify some of your posit iv* experiences with the 
Think About series. 






\ 










* w 

, * 7 • 


r 




i 








*> 


60. Please identify some of ybur negative experiences with the 
Think About series, „ ^ 


to 














» « « ■» 
















• 
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for teacher* not, using 
ThinkAbout this y,eer\ 



+ Previous tiJsers - , 

•ThinkAbout Teacher* Survey 
Wisconsin ET(}ucationc^l Television Network 
j May i$81 . 4 



Code No, 
*. Grade 



DIRECTIONS t ■ Pleaie circle the appropriate number for each item or* fill In your responses. 



Section Xt BACKGROUND INFORMATION 

i » 

1. How uny years of full-time taaching experience 
do you have? * , * 

2. fthich best describes the setting which you teach? 



years 



. JlO„ 1, Self-contained classroom 

5/"l 2» Units or team teaching ■ 

3* Departmental by subject (ipecify) 

3&h «• ot *» #r (Pl«««« ■pecify) j 



'3. Is t£ere>a content area ths.t yoi^ consider your speciality? 



4; How Mny teachers teach gt<ede 5 and/or 6, In your school? ^ 
V how »any of these teachers ere. using ThinkAbout? 
6. Are .any other teachers in your school using ThinkAbout? 



7. -How did you-*ust ThinkAbout? 



')/% 1, *NO 



pecify) 
Teachers 
Teachers 



s/y/i. no 

2, Yes (explain) _^ 

. **r/ * *»» 

1, As a .subject matter in itself 

Pt% 2* Only as part of language/ a rta 

\h% 3* Only it part of soclsl science 

' 4.' Only as part of mathematics 

-}tfV„»5. Vith a combination of content areas 

* ■ Other (specify) ' 



8^ How did you use ThinkAbout in relation to traditional curriculum , * * ; 

materiel (e.g. textbook)? ♦ • » 1. Aa an altern*ative or replacement 

■ 2#%2. As a supplement or addition 

519*** Aa enrichment 

. , ' - . 9 . 4'. Other (specify)' . 



9. Whst was the total number of your students using ThinkAbout? M~lH 



Students. 



10. What groups of your students us A ThinkAbout? 



•/$>% 1. All 



Special groups only (specify) 



11 



12. 



Who was most influential inf the decision to uie ThinkAbout? 



Nhere or from whom did yo6 flrstr hear ebout -ThinkAbout? 

i - 



f 



.13. 



Wh^t In-service have you recetytdVo^^ing ThinkAbout:? 



Hi 



"iT. Is Think/^out tht*ff irst'JTV series -you have uasdV fr 



lr + . 1. State J ; 2. Cehtrsl administration* 

a* i. Building principal 4. Media ipecialist* 

' $^5. .'You' 2d>,*.^ Other taacheri 

, 7 » y ITV representatively. Combination of *above~6r 

* 1 « other (ipecify) * 

H% *• Professional meeting * * ^ . % ; 

~2.. ITV representative 1 * - 

* '¥i9„3.{ Parade of Programs. fc I 

* 4. Workshop . ' 

• 5. Other teechifrr * * 7 
"a". Building principal • * 

: Nailed brochure 

8* Other (specify) 



.^7^1. None 

2* School, workshop , (presented by 

3. # District workshop (presented bV^_ 

H. Regional workshop (presented by _ 

5. Other {specify) * * 

* • 1 ; ' 1 



^r> t l. yea 



NO 



(•pelii 



lfy others you hav^ used) 



0SCTION »<_ USE OP Think About 
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15. Why art you not utfing Think About thia year 7 
• (tteaae'ba,,apeci{lc) < » 



16* -Qo you plan on ualng ThinkAbout next yaar? 

17*. Apprpximateiy how manjr of tfee 60 pro^taW "* 
did you uae leet yaar? - 

X$ ♦ What typt of .aupplemental majterlala did you uaa 
with ThinkAbout \aet yaar? 



r 



programs 



1 ■ 



19* What auggaationa deV you hava for aupport * 
mater iala, lika woilkbooka or duplicating maatera, 
to **k# ThinkAbout more effective? 



-».Hdw important t ara that a goela for your 
atudente* inetructio/ial program? 
roc your atudanta to. . . 

20* ba problem aolvara. 

21. tja in&ependent^leernera. • , 

22. effectively axpraaa themaelvea. 

23. manage their own learning* 
*24. reason eyatenatically. 

25. think flexibly. ' . 

How would you rate -the : eucceee of ThinkAbout 
last yaar in, atrengthenlng your atudanta* * 
% ability td... * r * " , , 7 

26. be problem solver a. » 

27* be independent laarnara. 

1 * - ' * * 

2tl a ff actively axpraaa themselvee. j 

' , ' • ** 
29. aanacje tha*ir-own learning. y * <, 

30. iraaaon aye tenet ically. v * 

3iC thirtk flexibly. » 

32. Wt)4t differences have you obeerved in your atudanta this 
year fro* your students lam yaar in thair thinking 
'skill a, problem sowing , and independent learning that 
"may ba attributed to not using ThinkAbout? 

/ » - 

^3. WhaC ia your overall rating of ThinkAbout? 

34. Please identify some of your positive experience a 
. with the ThinkAbout 'ear lee. 



J5, 'lease identify aome of your negative experiences 
with ths ThinkAbout eeriaa. ♦ - 



TT 



**** 



• not 
Important 



Wry' 
Important 



4- 



vary 
lava] 
. succ< 



low 
of 
aa 



■if= 3-8 

' 9 3 
3 V 
^ 3.1 



Very nigh 
l«v«l of 



5. 



Vaty Poor 
1 



Excellent 
4 S 



■Pi'-*. ,* 



-Cotpwittat 



T 7 " 



Telephone Interview Form 
THINKABOUT Evaluation 
May 19 §1 



Date: i 
Teacher's Name; 
School: 
City /Town: 
Phone Number: 



intervaewer : 



Code No, 
Grade>: 



Hello: 



I ajn * (ypur name) and I work for the Wisconsin Educational - 

Communications Board* About two weeks ago we sent you a letter ajid a - 
questionnaire regarding the television series THINK ABOUT • (Pausp and; let the 
teacher confirm receiving -the letter*) I^would like to" ask you seven " 
questions about your pse of THINKABGUT if you have now. (If not, "What 

is a convenient time for me' to call, again?") " 

- f • 

r * - , . » ■ ' v P . 

;{If the teacher has time, proceed with the <quest ions.) - * 



1. 



Dicl you elect to use THINKABOU/T because* it fits' well into your existing 
program, or because it offers something 4 different from what, you normally 
emphasize? . - . ' • 



Do you us£ THINK ABOUT a*s part of a particular, subject Matter? Jf-so, 
yhich* orte? (probe to ( find put if THINK ABOUT xs used separately or to 
su-oplemept • other ^subject area? — social studies, language arts, ? 



matr 



:ics, etc*) 



& 



What -activities relate^ to THINKABOU-E do you do with your Students, and 
what approximate classroom time per week is ^jpent £or each? (Try 'to get 
information on jj^£-procjram discussions,, ^number of programs .viewed each* 
week f and post-program actij*ities, as well 'as any projects or other , 
activities directly 'related to THINK ABOUT..) ■ 



^ *4. What* have you found to be* the most 'effective way of using THINK ABOUT with * 

^ ^, • * » your 'students? .(Probe to find out how THINK ABOUT ha,s been adapted to the ' 

^ . >teacher?s program.) . • ;/ * * . * • 

. " f ' ' , ' • 

* r* ] * . ' ' ft " 

- ■ V . * \ * 

* 5. . What 1 do you feed £our students have gained f rojn viewi^j THINKABOUT? % (tfry 
* - to get specific examples of s-tudents applying content from THINKABOUT to. 
*' i. r vtheir lives at scKbol or home.)e» p * * ^ 



; JS> -Whatr could be done " to make your use of THINKABpUT more effective?. (Some 

ideas may be' t^> provide supplemental material, to hafve student review , . Nj 
sheets,- Jt-o provide, a list v of student, projects, or to^hav^ari>. in-service •) 



A c 



7. do you know of any other teachers who' are -us ingf , T&INk ABOUT in** a special ] ' 
Vay that we should, know, about? " fTry to get names,) ^ , , "J * 



4 . 



} \ 
9 



Th&nk *y° u f° r your ftime. This .summer 'a report will be written &ase<l on yoyr * 
Jesppnse^ and those "of- other '.teachers, >A copy c?f this report will be' sent! to 
; you in September/ * 



» > 



■» v . . .c 



Sft 



I 



* * m * 



On • * 
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Appendix B 
Student Questionnaire 



Included in this appendix is the questionnaire given to some students of six 
teachecs. Questionnaires wer.e received from a total of 29 students from classes of 

* • ' V 

five of the teachers/ The means and frequencies of responses are included on the 
form? * \ y ' 



I. 



i 



V. 



} - * 



•1 



\ ^ . , 4 . .\ \ • 

' -85- 

^ * * Community No. a 

Student Survey on ThinkAbput 

{ i 
We are interested in your personal and honest opinions of the ThinkAbout series. Please circle 

'the answer- which best tiJts-your teelings or opinions. Your answers are very important to us so 

please answer all questions by yourself. When completed, return your questionnaire to your 

teacher. Thank you. ■"" r 

Look at each of the statements made about the ThinkAbout jprograra. If you agree with a statement, 
draw a circle around either Strongly Agree (5). or Agree (4). , If you disagree,* draw a circle 
around either Strongly Disagree (1) or Disagree (2). The question mark (3) means that you cannot 
decide. , ** 



N=29 



Mean 



I. ThinkAbout programs help i me to come up - 4.10 

with new ideas. 

, K 2. ' ThinkAbout programs are not usetul in 2.24 
solving my own problems. , • ■ 

,\3. ThinkAbout helps roe to thirtk in new and . *J 3> 72 

different ways." 

4. ThinkAbout programs help roe to learn on ^ 3^62 
ray own. * • / * * 

» f ■ 

^ 5. ThinkAbout programs help jne to say better 3.21 
what I really want to say.' 4 

'6. ThinkAbout* has shown roe how to sdlve * " • 3.45 

problems on ray own. \ 



* \ 



7. ThinkAbout has helped me learn fetter 4.03 
ways to solve problems. • 

* 

.8. ThinkAbout helps^me to organize my thinking. 3.7$ 



9. ThinkAbout helps me to see more than one - * 4.31 

♦ way to solve a problem. * ^ .' 

• \ ' V ' • ■ ■ . , 

10. * ThinkAbout programs siy^w roe how to think- r 3.59 
o. clearly, st^p by. step»* f 



11. I want to 'learn more about the £hings*I' i 3.72 

see in ThinkAbout programs. r j% 9 

1£. I like ThinkAbout very much. < 4.. 21 



Strongly 








* Strongly 


Agree 


Agree 


? 


Disagree 


Disagree 


5 


4 


3 


— i— * 

2 


1 


38% 


38%' 


21% 


3% 




5 


4 ' 


* 3 . 


2 


■) i '. 


3% 


7% 


28%: - 


: ' 34% 


28% 


S 


• 4 


*3 


2 


' " 1 


17%. 


55% 


1-7% 


3% 


7%* ■• 


5 


4 


3 


% 2 


1 


21% 


3,4% 


34% 


7% 


' 3% 


— 

5 * 


4 


3 


2 


1 


. 7% 


* 38% 


28% 


24% . 


3% 


5 




3 




it 
1 


' *24% 


1 I7% 


45% 

• 


7% . 


-7% 

r * 


5 




3 . 


- 2 




24% 


. \59% ' 


14% . 


3% 




5 


4 


. 3 


2 - 


1 


21% 


' 41%* 


"31% . 


*7% 5 


** * 




f 






i 


5 


4 


• 3 


2 


1 V 


52% 


J 31% . 


14% 


3% 




.5 


4 ' 


3 . 


*2 


<r 


17% 


41% 


' 28% 


10% 


3% 


5 


4 


3 


2- 


1 


24% 


31% 


* 38% 


7% 




5 


4 


.-3 • 


* 2 


i* 


• 55% * 


2i% 


17% 


*3% . 


*3% . 



4 



1 



13. What is your sex? 1 43% male 2 . 52% y> female • * . 

14. "What gxade *are you in? 4" J e 5 ^ 41%) " 6 (W) 7 . , "e" 

* 15. What two (2). ThinkAbout proqpnjs did you like the most?' 58(re=5), 57(5), 56 (4 ) ,* 2(4)., 59(i) 

L L * • m , . 

16. Wha^ two {2) ThinkAbout programs did you like the least? 36(4), 5(3), 60(3) , 33(3), 51(3) 

r ' ' &m 

CD 9 r >». ? ■ Q ^ Ttenk you very mucjj! 
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Appendix C 

Four Interview Problems arkjl. Scoring Schemes 



\ 



* 4 < 



.L. 
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Appendix C 



^ Four Interview Problems ^and Scoring Schemes 

Included in this appendix are th& fbuc problems given to groups of four/ 
students each to solve. The scoting scheme is included for 'problems 1, 2, and 
The* §pheme for problem 4 can be obtained from the Agency for Instructional 
Television (AIT) , Box A, Bloomington, Indiana 47402. 



Problem 1 



^Can nine Wrbles be distributed into fiye cups witfi'a dif ffecen?. number of** 
c '"marbles in each' cup? * «> * 



' Explain youS: answer. . r< ~ * 

Scoring Scheme; Ifc>£al joints possible: 10. , * ' * • • 



Understanding (0-3 points) : . \ ' / - ,X 

•Points* ^ ♦ „ . s ^ < * ' 



, 0 — Did not understand anything. , * ■ * " # * 

1 . — Understood some conditions but,not;;all^ ' , 'V a 

- 2 — Varied a condition to 3olve the problem. 

3 — Maintained all tfye conditions. *" ' \ 



MeansrJO-4 points): »; * * ^ . 



• ' ... 0 ^V" Did no ^ attempt anything or could npt explMn anything. 

1 — Gave a random guess*, - 1 , A 

2 — Gave some thought but could not^reach an' answer or di<L'not 

know what^ to do. ^ - N 

3 — Ha$ a plan or -a means to find the solution and began* to 

■ ' v ' carry out the plan. Means was solution by exhausting other 

r ♦ , possibilities. 

4 — Had a plan and carried the plan to. solution/ * 

„ .Solution (0-3 points): ' . — N ' 

Points* ' « ' \ ' 

* < 9 ~ \\d not have a solution * 

'I — , Ca.rt of tha solution was correct i>ut with some modification 

of the conditions. ^ 
2^ — -Found a wrong solution only because of a- computation error. 
3 ■ — Gave a correct* solution 7 -The problem cannot be done, because * 
, the sum of the , first 5 integers is greater than 9. 



\ 



v 



4 r- 



V 



'{.''•.«...• • « ' - • - 

\ GO TO ffHE NEXT PAGE IN THE FOLDER. • \ 



9 
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• • * 

Problem 2 ' \ 



* 4 



Btfrry^aaw some men alongside *a % higfrway. * One* was holding a "H^lo*. Another was 
„ # about 30 mbtenfpaway £rom the. pole. He was looking toward the pble through 
something which was" on- top of/ir-three-legged stand. The stand looked very 
sturdy. ' * * - v 

,#Bar # ry*has an art class at school. .The students work on paintings which are 
. set oh % three-4jB4ae(? easels, The easels never wobble. 
I * . * ' • , 

*£arry had his picture taken.V He noticed that the camera was set on a ' 
'three-legged staod^rHe asked. the photographer ho\^ eome. The photographer 
^ said that? the. £tand held the* camera so it wa&^st ^dy . Elarry asked why sW& 
^d^dn* use # » % ^ stand with more legs s\>it would be\even more steady, , The • 
photography said that a stand with more^than three legs would be less steady 
£hqn a stand with three legs. / Barry didn't understand why / but he believed 
^ -*her, s^infceVjsfce seemed *to know wha*t she wae ttalking about. 

"When Barry got home/ he\sat at the kitchen. 't£ble to drink some milk< 



. -fcthaijrwas wpbbly.^ He rfertfcembered what the photographer had told hini 
\«^ w V nd cut«pff one of tfce le^s of the^chair, - The chair fell over. 1 

* y ) ^ * * , * * 

Wh^t/*wa^ wrong with Barry^s reasoning? Tfcat'is, why do you suppose that f 
three-legged^ stands work. so well sometimes and yet the three-legged chair 
didnyk work?* j[And why <3o you suppose that"the three-legged stands were 
•* . steady, but the, tour-legged kitchen chair wasjv' 1 steady?) (Harnadek, 1979). 




\^Wri.te your answers here. ' M . * 

• * Scoring Scheme: Total points possible: 3. , 

Characteristics of .a \hrpe-iegge,d stand (0-1 point): 

Group must have made some note ^of properties of a three-legged 
stand such as the weight is nearly, equally supported by the 
three legs. • ■ 

' H * ' t ' 

y Characteristics of^a four- lagged stand (0-1 point) : 

• ^ Group must have made stom§ note of properties of a four-legged ^ 

f # Stand such as the chclir was made to have the* weight equally, 

."distributed over four legs. 

Relationship between the two-.-threerlegged stand and a chair — and a 
conclusion (0-r point): ^ 

Group mul^t have tied the information together such as wtien one 
leg on~the chair, was cut -off, the weight was no longer^equally 
* distributed -among the -three legs like a three-legged' stand. The. 
t chair fell over because > there was no.thing to ^support the weigl£ on 
^ ^ the corneraf the chair where the leg was cut off. 



GO TO THE NEXT PROBLEM IN TOE POLDER. 

ERLC / ' J.' ■ ^ 
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Problem 3 - . 



/ 



You' have been given the go-ahead to start a radio station for" your school. 
'What would you do to plan for the station? How would you decide what programs 
to broadcast and when the programs should be aired* a 

Write all of your ideas on this paper. > . 1 • 

' Scoring Scheme: Frequency of responses: „ * 

I \ " * 

|4 Tactical responses (count- df ail responses): * 

it „ 

A response that is a feature of the station such as equipment . 

(speakers or micropho nes) , building, pe rsonnel (disc jockey, ~ 

reporters, or wea'ther person) , or programs (music/ sports-/ or 

announcements). * * ' * * 

a 

s x • , t 

Strategical responses (count of all responses):^ 

% A.response that indicates planning or mak'ing decisions in some way,. * 

such as asking people what they want", deciding on what is needed, 

t * A 1 setting up a schedule or 'plan of how the time is to be us^d, or 

identifying needs. * • , * - 

Sco{*e and dimension (0-1 points): ■* l t s 

* Some^ mention of time requirements, plans, or s.teps to follow in 
setting up station. - 

Information (0-L points): ; , * . N 

^ "Some note of seeking, information, such as taking a surveyor poll. . 
Resources and equipment fO^l points): ~ \ 

-Some mention of assembling necessary resc^rce^ or vtfiat equipment is 
needed to operate a 9tationl^- »\ 

Sequence of steps (0-1 points)* ^ 
*An ord.er was given\to the steps to follow. 



^FOLDER. 



, AFTER YOUR GROUP HAS EXPLAINED WHAT YOlAouLD DO, GO TO THE NEXT PAGE IN THE ^ -\* 



problem 3 , p<jge 2 



List what informatipn you would 'hive to 'have in. order to start and run a rad 
station. ^ f * I' 

1.. Information (couat of all responses j(: 

2 * The number of responses that are ty^es of in£6rmation (how ta 

opera.te equipment or what^ people like to heat) . \ 



Equipment (count of all responses) 



3, 

4. - 

The number of responses that are types of equipment (speakers, 

5. building, or disc jockey). ,n • i 9 

i 

List what resources you would use to find the Necessary informtion. 
1. Resources (count of, all responses) ; 



* 4 
2. The number, of resources listed sutfh as somebody who works at 

a station, library , or books. 



3. 
4. 
5. 



4 1 b • 

List the stops in the order you would folJLow.them that you Vould take to 
decide what should &e broadcast,^ 

1. 'Decision steps (cpunt all of ' responses) : 

2 * The number of appropriate steps that would. help to decide wh^t 

shc/uld bo broadcast, such as identify different types of music, 

3. conduct a pollv determine which type of music people li'ke, or 

decide aft«*tlie time to -broadcast programs. 

4 % ' . \ 

Sequence »(0-l points) : 

5 - ' 9 ' : \ ' ■ • X 

The steps* given are given order . * » 



GO TO THti flEXT PROBLEM IN ThE FOLDER, 



\ 
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Note: The Scoring scheme for this problem can be obtained by, contacting 

•the Agency for Instructional Television,' Box A, Bloomington, IN 47402. * 



em 



. 1- 



Q * v " Jim's Spacecraft ' , \ 

Jirnsuddenly remembers that the Science Fair wilf begin soon. He hopes it is not too late to enter 
the contestj^rri wants ta build a model of a spacecraft big enough to hold him. Jim has a large 
^ cardboard box in hrs garage. It is just perfect for theKody of the spacecraft. The garage is atso * 
i filled with wood, tools and gadgets. 

Jim knows he probably does not have enough time to build a spacecraft alone. He has a lot to do 
) and is eager to start, - ? 



1 



ERLC 
-A 






en_you have read the sttSry.'ycfcy may go on to the nex{ page; 

© Ag«ncy>.fo} Inmuctiqn.l Tfrvijion ' / " .- v , - \ '• » 9 *• ' J. 

Th. U«.lopm.o, ol t*i. .ifel h „ „.,'„ , upporu<J oy f ^«,, Th. Corpo-.ipn f"o. pj b .,c {j/o.dM.ong. ? " : 

— I i_i i^iJ — : lj '—J. — . L_ J^j&J. - — — _: — L_ 
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■ . ' * 2 

Jtm decides to make a plan so the spacecraft will be finished before the Science Fair deadline. • 

But first, what things might Jim want to know in order to set up a pten? Make a list of questions 

*. . 
that he might ask: '.*'"• 



/ 



, 2. 



V 

.J 3. 



I 



/, 



When you fir*fsh;.you may go on. 



ERJC 



/ 



- r 



/ J 1 -I J 



Now that Jim has some questions in mind, where might he go and who mjght he talk 
to find 'some answers?, * - ' 



. f 



1. For example, how might Jim find out the Science Fair deadline? Write your idea 

• . 5< 



.' 7 



{ 



■ I 



I 



2. How nigrit Jim find out more about actual spacecraft so his model will look real^Write 
your ideas below: j> ° 



A good planner thinks ahead to the different things that most be done to build the spacecraft. 
Some of these things must be done before others. For example. Jim decides that. one of the last 
jobs is to paint his spacecraft. But many other things musf be done before! What are some of 
them? </Vrite below what might be Jim's-fiVst step. You may then add as many steps as 1 you wish: 

/ T - • V. . ■!■ 

'1. A first step is: 



2.. A second step is: 
• t 



- J 



3. A third Step is: 



5. A fifth step is: 



•J : 



When you finish, you may go on. 



♦ % 9 



^4. A fourth step is^ i 



After |ifn worked many- hours on his project, he suddenly finds that the Scieribe Fair deadline is 
.soondr\tlf>an he was told'. He might not finish in time! What are some of the different kinds of 
things IhW'he coulddo now? Write -y|W ideas below. Number them a* you go: 




- When you finish, you may go on. 



7 
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Appendix D 

Stddent Responses and Scores to problems -1 and 2 



V 



Included in_this appendix- are* the written responses given by each group €o 



grc 



problem 1 (Table Dl) and problem 2 (Table D2) • The score given to each group is 

* » 
•shown to the xight ot the" response. 



■ > 



V 



9 



\ 
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*Table.Dl 

Responses and 'Scores on* Problem 1 
by Group > t 



i Ptob 



- v 



Group Response 



Score 



Und. Means Soln. Total 



115G1 

115G2 

115G3 
215G1 

215G2 

2J.5G3 

315G1 
315G2 
315G3/ 
126G1 

126G2 
126G3 

226G1 

226G2 

226G3 
326P1 

326G2 
3i6G3 

136G1 

136G2 

136G3 
235>6g1 
235/6G2 
235X6G3 



.Yes, ther<* would be ^ne in the l4st and two in 
the other four cups, (diagram) 
Put two marbles in fc^ir cups and put" one in the 
other: „ 
No,' We tried hard. We tried everything. 
No,- Because you can't use, the same numbers in 
a cup. (diagram) 

No, If you take the five lowest numbers it will 
equal to fifteen. 

No. Because you wovild have to repeat the numbet 
. in the cup. 
No, you can't, (diagram) 

No. * .Not enough marble to go in five cups. 
x No. (diagram) • 

No. Because five doesn't go into nine evenly. 
. (diagram) * 
No. There. aren't enough marbles, (diagram) 

* You add 1+2^3+1*1/2+2 1/2, which will add up* 
to nine, (diagram) • ( * 

Two^in one cup, 1/2 in orie cup, .one in"6ne cup, 

2 1/2 in the* other cup, 3 in one cup (diagram) 
No. 1 There is no possible way to put nine 
marbles into five cups without using the same 
number twice, (diagram) * 
No, because, it is an uneven number. 

• Put five in .one cup, zero in another,, one in 
twp e of thera, # two in one cup. (diagram) 
Split them in half, (diagram) 

4 Zero in one cup, one in one^ cup, two in one cup, 

3 3/4 in one cup, 3 1/4 in 'one pup. . - 
,No. You would have* to haVe the same amount 

v r * 

of marbles in some cups. 

%es. You* cannot do it unless you cut them -in 
(diagram) • , 
Cup inside a cup (diagram) > 
Five doesn't go into nine evenly. , 

Because you can't 4ivide nine by ftvey 
Because if we put one *in number one and^ 
in number two and three in numbed three, 
we have three le£t. put we used the numbers 
one, two, and three, and we can't use them 

again, (diagram) s 

/ < / 



half, 
No. 

Yes. 

No.. 

two 



1 


, 3 


• 1 


5 


1 


. 3 . 


1 




3 


2 


2 


7 


3 


3 


3 


. 9 


3 


4 


3 


10 


c 

3 


3 




9 


3 


. 3 


2 


« 8 


3 


3 


3 


9 


3 


3 


* 2 


8, 


2 


3 


2 


% 7 


3 


3 


3 

» 


9 


2 


4 


1 


• 7 


2 


4 


1 


7 


3 




2 


8 


3 


2 


2 


7 


1 


. 3 


1 ? 




2 


2 


1 


5 


1 s 


4 


1 


,6 


3 


4 


2 


9 


3 


4 


2 


\ 


3 


3 


2 




2 


3 


2* 


*7 


2- 


3 


1 




3 


4 


3 


. 10 
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' Table D2 
Responses and Scores on Problem 2 
by Group 



Grqup 



Response 



Score 



Properties 
3 -legs 



Properties 
A legs 



Concl. Total. 



115G1 



115G2 
li5G3/ 



215G1 
215G2 



215G3 



3J.5G1 
315G2 



315G3 * 
126G1 / 

126G2 
126G3 . 



The chair had four legs and if you % 
took one off the chair would .have two^ 
on the other side and. the sides would 
not be* even. The camera had three legs 
that were not together; they c^idn't have ' 
to balance like the chair. 
It does not matter I19W many corner?^ there 
are; ydu just have to balance the chair. 
The weight was uneven because the three- 
legged stand' .had even sides. And tfie 
four-legged chair didn't have e\^en sides. 
One leg was cut off. 
It's unbalanced* • ^ 
It'-s not equally balanced because there 
are two legs on one side and one on the , 
other. - - 

When he sawed the kitchen chair: it .feli ' 
oyer because: it was set, up. for a fourr 
legged chair and wasn't centered right. 
But with a chair with three legs, that are 
centered right it wouldn't fall ovejr., 
'Because the lags were in wrong positions ^ 
Th§ legs on a chair have to be, in a cettain 
place to stand up. If you cut off a leg on 

a camera stand, it would fall over. 
* v . 

You have to rearrange the legs or you'll 
fall. 

He thought that an object could balance on 
three lec|s,and not_hayjf meeting at a point 
'because the object \ would" be centered in the 
middle, (diagram) * 
Three-legged stands are steadier because 
they are set on an angle.,, The four-legged 
chair wouldn't be steady because the leg 
was uneven. 4 ■ - 

It you have, 30 lbs. of. weight on a tripod v » 
chair f you've got ID lbs. of weight per 
"leg. ' But if you have, four legs you have 0 
7.05 J.bs. per leg. When^ou have more 
weight on one leg, that leg *with;raore 
weight wiJbl be steadier because it will 
stick to your flopr /surface better. 



1' 
0 



1 

0 



r 



0 



■A 

0 
0 



1 

0 • *" 

0/ 



1 > 

0 



2 
0 



i 2 
0 ' 0 



•0 

0 



1 . 

0 



J 1 



|m f. 



Table D2 jcont.) 
Responses arid .Scores on Problem 2 
fc by Group 



N 



Group 



Response 



Score 



♦ \ 



Properties 
, 3 legs 



Properties 
4 legs 



Concl. . Total 



126G3 
(pent.) 



226G1 
* 

226G2, 

226G3 
326G1 

326G2 
326G3' 



136G1 , 



136G2 



136G3. 

&5/6G1 

235/6G2 



235/6G3 



A three-legged stand has' its legs^ in a 
triangle, plus they are at an outward 
"angle. A tripod is wider on'ttie bottom. 

v The chair was bigger on top. (diagram) 
A three-legged chair is more balanced ■ 
than a four-legged chair with .one cut 
oitj { (diagram)* - , 

If you had a four-legged stand and one 
leg was shortertr7 then it would wobble. 
And if you h/d a t hree-legged chair it 
would t*i It one' way and would riot wobble. 
You have to ha,ve two in f$ont and *one in 
the middle of the back. J ' ' 

Three-legged stand^has three legs and 
•point to the- middle with a metal *disk. 

• four-legged chair and if you cut off one 
leg the chair would be unbalanced. 
There was too much space when he cut off 

♦/the 'chair leg, but on the camera stand it 
was even s.pace. °> , J** 

The chair co 4 uld have been wobbly because s 
one of the legs was, uneven compared""?^ the 
others'. For the three-legged stands the 
legs aire all centered. ,He n(ust have thought 
that anything with three ^egs was steadier, 
than something with four. % ^ 
The legs are not placed right -if you cut 

' ohe off of a chair that used % to v have" four 
♦legsv • * , 

Vheir weight has -to be 'equally distributed 
over three poirnts aiid the'y have to be ip 
the right position, (diagram) 
They were not* even'* (diagrafo) . 

, A camera *is lighter fcifcin a person. ;* 
An easel*is iike / a traingle' and that. " 
•position holds it up;* but a.^hair is like ~ 
a square; if you take a leg away, it will 
fall. " ' * - w 

Because the camera stand came out like 
this, (diagram) , Aria the chair fell down 

„ bedause it was ma£e for four 4 legs not 
three* * 



0 



0 
0 
0 



0 

p 

» 

o. 

1 1 



1 

.0 

o 



11 05 



r 
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, v « Appendix E 

# r . Request for Participation 



\ 



ERIC ; ; •; 



X 



y 



10S\ " 



» ' • v. ' /' 



) 



I 



- impend rx E ♦ 

• i 

• -* * 
* * 

• y <** Request for Participation 



Included in this appendix are the postcard that was sent to a random sample of 

600 graders and grade 6. teachers in Wisconsin asking^ if they would be interested in* 

* * ■ 1 

participating in art evaluation of THINK ABOUT/ and the letter sent to those teachers 

* • \ » ' • n '" • < * 

se>e<^fced to have their* students observed as they solved problems'^ 



I * 

This April and May the**WEtN v/ii<j* be x evaluating 
ways .of bettfer isupporting the ITV series . • 
THINKA80UT . We invite ^pu to take advantage of 
this opportunity and participate with.ys. . 
Please help^by .answering. thd, following questions 
aod maiMng -this postage paid card today. # Your 
prompt -reply is m appreciate^,/ ' ; 



Are you «sing thinkabou* :-;s.*ye'ar? 

Regularly Occasional ly Never 

Oid you use THlNKABOlft las: .vear? 

Regularly * Occasi;,~3lly Never 

Have your current students # jsed thInkasghi 
both last year' and this .ear? 



Yes 



,No 



>WlSCO|^fl.g6uC AT JOVIAL TELEVISION, NETWORK* 



A. what grade are you teacM~f: this year? 



5th* i 6th 



ott»er 



W^ouid you* like to participate further in 
the evaluation of THlNKABCuT? 



Yes 



•Request Postcard 
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Letter Requesting the Observation qf f 

* . * Groups of Students ^ 

May 1, 1981 . ^ - " 

The information you provided us oo you* use of the instructional 
.television series THINKfcBOUT and your interest in participating in* 
its evaluation is greatly appreciated.* Our main purpose in 
evaluating THINK ABOUT is to 4 determine what support we c«n give 
teachers who are using it and how d *it can be better irtpleraenfeed . 

* \ ■ 

One /part of the evaluation will involve observing small groups of 
students &s they solve c problems. Of * the 96 teachers who have . 
volunteered to* participate in the evaluation, you have been 
selected to be one of the nine who is being asked to be in tfyjbs 
part of the evaluation. Three of the teachers have used THINK ABOUT ' 
regularly for two years. Three of you have used THINKABOUT 
regularly tor only this year. Three of you are not using 
THINKABOUT. We understand that you are us«g THINKABOUT this year 
and you are teaching grade 6.* , ^ 

, What will be t involved is: ; • 

To have three small groups of four; students each observed as 

the group Works on three problems. The groups will be randomly 

selected from your blass. The time required for Qach group will 

be one. hour. - " * * 

* 

For you to complete' a questionnaire asking about your use of 
* THINKABOUT apd your instructional program. The estimated time 
to complete the questionnaire -is 30 minuCfes. * 



For group .scores on standardized achievement tests » taken by * 
your students, to be supplied if available We are only 
interested in group scores and not scores for individual 
students. Since students will be" tested from nine different 
schools, ve need some indication of how comparable students^ 
from different schools are on achievement. 

j 

The testing of the students will be done sometime between May 11 
and May 22. Your par£icipateion in the studtf will be kept 
confidential. The report of the eyaluation^will not identify any 
of the schools or teachers where data were collected. You will be 
sent a Report of the evaluation and kept informed of any 
-supplemental material that is prepared as a result of this study. 

• I will call you on May 6 to see if you afe interested in being in 
thirfpart of the study, and to answer any of your questions. 

> : • ~ v k 

Sincerely, „ *v * 




, Norman W^bb 

Manager of Educational Research A 
Educative .Services \> 
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A^pekdix F 



Check of /Agreement of a Transcription . m \ m 

i ' * . 

' ' * I k 

The transcription of the* discussion of problem 1 by group 215G1 was* done by two 
people to help ensure the transcriptions were accurate. The main transcription was 
done -by the investigator who did allf-of the transcriptions. The check was dor^ 
independently by another person.' & * <>h£ ' 



Problem 1. 215G1 
JJ Transcription cfiecfr 



"No, beq^use nine 'isn't an even number*" 
"Yes.. 

"In $i/e <^ps?' 
."Oh. - 

••You figure it out." 
"Thanks a lot." 

"Well you were in the highest math 
group." / 

"You could put one marble in each cup." 

"There would be four marbles left^." 

"Put two in each cup." 

."There would be one left.," 

"Draw five. cups. No, just draw the top 
of them." * 



"blow what?" 

"I've^got it. ..two, two, two, twd..." 
"No, there has to be a different number 

• in each cup." 
"Thre^ each." 



* V\. •three left." 

* "You can't -use one over' a§^in." 
-"Can tpo. 



ag^in. \ 



"There's only five in 



"Put.. .oh y£ah, you can't use- two." 
"This, is almost impossible* H 
"I figured it out." 

"Just say no. . .our answer would 'just 
be no." 

"One, two three. . .sev*n, no..." 



"Ncr, you don't." 
"¥es, I*do." 
"YotT&o not." 
"Three, two r one. . ." 
"That's six." 
*0h, three., .no."^ 
"That's nine already'. 
"Put one. . ." 



"It's imM^ble.' 
"Oh , no 0 rH^Wiot • ' 

"Yes, it is;*- 
"It 1 s- impossible. 1 



*"No, because nine isn't an even nufnber 
"Yes*.. ,% * 

". ..with five cups." ' > v ~ 

"Oh." * 



\ 



"One marble in each cup." r 
"But then there would" be f out 'left." 
"Put two in each cup." 
"Then there would be one left." 
"Draw five cups." 

"No, just draw the top of them." - . 
"Now would be. . ."' " , m t 

"I got it. Two, two, two, two, one."* 
"No, it has to be a different number i 

each cup." , ^ 
"Three each. .. three . " 
"Three left." [ 
'"You c^an't use one over again. 4 * 

"There is only five there. . .six." 

"You erase tlje one." 

"Six." 



"You figured it out." 
"Is this. .V" 
"Just pay no." *• 

"Our answer will just be no/ 

"Three, . sfcven." 

"No." 

"Yeah." - 
"No, you don't." 

"You. do not." 
"Three, two, ,one." 
"That's six." I 

^"That's n£he already." 

"Put one" 

"One or two" 

"That's nine already."' 

"It ' s ■ impossible . " 

"No it's not*" 

"Yefc, it is.*' 

"It's .impossible." 
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*"It is not." 
"It is too*" j 
"Three..." j 
"Why don 4 t you 

It?s impossible." 
"It is not." 
"Why- give up?"j 
"It is too.* | 
"Is notj." I 
."Is tocL" j 
\s"Oh 9 quit actinq like 



•<£>ap? 



"It just asks you if it can> agd I say 

it, can't." V 
"Okay, put Linda. 91 s answer down." 
"It can't be done." 
"Can you use v the same number over 

again?" * 
(I/m just listening here. „ 

It's up to the group.), 



"It can't be done. 1 ? 

"It says, canjnine marbles...." 

m "It's asking ydu if it can, not * 

tellini you it can." 
"Yes, it says a different number in 

each cup." • • 

"It says can — can it^be done, though. 

No* It's impossible;" 



'Yeah, , it is." r 
"Linda, you^re not thinking." 
"I km too." ' * 
"It's almost like trying to. put , • 

a square block, into a roynd circle." 
"That's 'easy — square block' [ ■ " 



"Okay. . ." 

"Make just round things. 
"Ho.' 1 



"It is not.". 
h It \s too." 

"Three, ^it's not impossible. 



"It 's: impossible." 
"It is not." 



"It is too." 
"If, is not." 

"It is too." ^ ^ 

i"It just asks you if it can, and I say > 
i it can't.* m 
"Okay, put Linda's answer down." I 
"See, it can't be done." 
"Can^ou upe the same^number over 
^again?" 



"With a different number." ' 1 

"It can't be done." 

"It says, -can nine marbles be... (reads 
problem) " 

"It's asking you if it can. It's not 
telling you 'if it can." 6 \ 

"Yes,, it say^~a different number 'in 
each cup." J 

"It -says can it be done." 

"Can it be done though?" *( v 

"No. It's impossible." ^ 
"Just put..." , A ' * 

"Yes, it id. 1 *' 



"It 's almost like putting a square block 

in aground circle." ^ 
"That's easy — a squarje'box whole.* 
"Or, how many cups?". •■ 



"No, just make round things. 
"No." 



"So what, Linda?" 4 
"bright..." 

"Use five." t . . ' 

"I got it." -\'. 

"No you don't. ..it's impossible*. 1 

. ii 



"Alright." 
"Five." 
I got it.." 
"Gads." * 
"No you. don' t*.\ 
'"It's impossible. 
"Six." 



"The only thing I cah use is a 

• two on one. " 
"You*ve got to be able to use some." 
"Four." 
"No." 
"Six." 1 

7A11 it's asking ydti is if- it. can 

b<* done. Just »say no. ■ Just put no." 

"You've got to try everything before 

you give up*" 
"We. did.", 
"We did." , 
"No,> we diidn't." 
"Not enough." * 
"Mir. Brain here is going to figure 

it out." 
"No." 

"Zero." K 
"Hey, we have to put a marble 
in each cup J" 

"Yeah, you can't put zero^marbles 

in each^cup." f 
"Can nin# marbled be distributed in / I 

five cups with a different 

number... it doesn't say you have 

to put at least one in.... 

it doesn't; it doesn't; " 1 * 
"George/ you're weird." ^ 4 

"Who's fault is that?* 1 ■ V 
"Three. . .now put three," 
"No, put four-, then three.., that 

makes seyen. " 

"Five.. I" 
"I gtiess we will have to*.." 
"He put a 'zero before." 
"Come hereT Give me that... 

I'm going to figure tliis out." 
'"So.* 

"Oh, the cups are too big." 
"I don't care." 
"Wait." 

"Why c^n't it be tetf?" 
"Boy/ that's really hard. 1 
"It don't work." 



"It will." 

"Nov it's impossible. 1 

"We h^ve our 'answer. 

^ done . " 
' n It l s impossible." 



It can't be 




9 



"Okay, I can use two in those." 

"I got to be able to use..." * 
"Four, six..." 



"Just say no." 
"Put' no." 

"You have to try everything before you 
give up." • r 4 

"We did." 

"^e did." 

"No, vqu didn't;." 

"Not enough." J 

"Mr* ferain hefce is going to figure it 
out." 

"No." 

"Number zero." 
^Hey. . .yeah." 

"Ycxu> have tb put a marble in each cup." 
"You can't put zero marbles* in a cup." 

Rereads problem. .. "It doesn't say you 

have to put one iq. ..at; least-one 
•^j in.. It doesn't. . It' doe§n't." 

' A T ' ' ' 



"George, you're weird." 



"Now put a three." 
"No, put a four. . . 
"Next is a three. ..that's* seven. 1 
"Five." 

"I guess we wiir haw to^. 
"We put a zero before." , 
"Come herel Give <me that pencil. I'm 

- going* to figure ,this out." 
"Sb." ' . • . 

"Your cups are too t>ig«" ' 
' ,"I don't carei" , 1 
"Wait." t 
"Why cant it be tep?" ^ 
Why, that's realiy hard." N 
"It don't work." - 
"Just put rvo>" ' , 

J 

' "It's impassible." % 
"No."- 

"We *hav^ otir answer. , .it can't be „done. 
"It's impossible." * * 1 



TT 
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"George, it's going to drive roe - 
, insane, trying to figure it out*" 
"I never give up. You guys give jap j 
too easy." 

"Since when don't you?" 
"Yeah, usually you throw a f^^" 
"You scream atme..*." ' 
"George, it can't bfe done." 

can't be done*" 
(Did you put youfc answer down, then?) 

*.Yeah, no/ 

(Okay, did you explain why?) * 



•No, 



"We tried it*" t 

"I mean! because yoti can't use the > 

"same number over,.. it's impossible 

'because you could... like you could 

do it if y^u, could use* the same 

* number ovet again. But you can''t. 

It says use a different, number of 

marbles in each cup." 
( • 

"If we're wrong*, it's your fault Geprge, 

"Does* that maKe sense? Because you 

can't... .*V 
"Ye^h, that makes sense."*. ' - 

(Okay, here's the nejct problem. ) 



• r - - 

"George, it's going f to drive 'me insane 

to figure it out." 
"I never give up."" 

"Yo^.guys give yp too easjr." 
"Since whejr^don' t'you?" * * 

"Listen, you throw a fit." , 



"George, it can't be done."% . 
"It can»'t be'jdone." ^ 
(Did you put your answer down? *iDid 
. you explain wjiy?) 



;"NO, no." 

"Well I never..." * / ' 

"Because we tried it." 4 \ 
"Well because you can't use the same 

number over. It: is impossible. . .you v 
k could use. . .like you could do it if 

you could use the same number oyer , - 
again. But you can't. It says *to u$e a 
/diiJferent number' of marbles ill each* 



/ 



I cup. 
"Wait." 



/ 



"If we are wrong it "is your fault George*" 
"Gee whiz."** 4 - < 9 

"Does . that make sense? Because you can't 
use the same numbers i3 a cup." 



•»/ 
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